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ACTION DECREMENT AND ITS RELATION TO LEARNING‘ 


EDWARD L. WALKER 


University of Michigan 


It is the purpose of this paper to set 
forth some argument and some evidence 
that what is herein called action decre- 
ment and what has otherwise been la- 
beled reactive inhibition (Ip) or stimu- 
lus satiation (sl) is, at least in some 
instances, positively related to learning. 
This is in contrast to the usually held 
position that it is megatively related or 
antithetical to learning. Furthermore, 
it will be argued that when one tracks 
the course of the action decrement ex- 
perimentally, one also, in fact, tracks 
the course of the perseverative consoli- 
dation which is frequently assumed to 
follow a period of training and is as- 
sumed to be necessary for subsequent 
performance. 

The use of the term action decrement 
rather than any of the other available 
terms stems from the following beliefs. 
Reactive inhibition and stimulus satia- 
tion are no longer considered suitable 
labels because of the growing belief that 
any psychological action or event is fol- 
lowed by a temporary restriction upon 
its rearousal. It no longer seems cer- 
tain that there is an exclusive rela- 
tionship between action decrement and 
overt responses or to stimulus events, al- 
though it is admittedly difficult to deal 


1 Most of the work reported in this paper 
has been made possible by a grant from the 
National Science Foundation. 
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with psychological events which are not 
stimulus-aroused. In short, the posi- 
tion taken is that the action decrement 
is a central event and the relevant sym- 
bol would thus be (7). 


The contrasting points of view with 
respect to the role of action decrements 
can be elaborated on both a common- 
sense and on a theoretical level. On a 
common-sense level it is reasonable to 
view fatigue and fatigue-like states as 
biologically useful in preventing the or- 
ganism from exceeding its resources and 
thus suffering damage. Such protection 
could be regarded as a sufficient func- 
tion. Also on the common-sense level. 
we all know, or think we know, that a 
tired organism learns very inefficiently. 
Thus common sense tells us that Hull’s 
(5, 6, 7) projection of these antitheti- 
cal and detrimental effects to the theo- 
retical level is eminently reasonable. 

However, common sense sometimes 
provides contradictory propositions. It 
is possible to say that learning is not 
likely to occur without practice. Much 
practice is associated with much fatigue. 
The more one practices, the more one 
learns. Therefore, the more fatigue, the 
more learning. On a formal logical ba- 
sis the conclusion is not certain, for 
there is a logical fallacy in the sequence 
of premises. Therefore, empirical dem- 
onstrations are required to establish the 
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truth of the conclusion. Several will be 
cited subsequently in this paper. Fur- 
thermore, the protective character of 
the fatigue-like state is retained, al- 
though the object of protection is a 
perseverative process rather than the 
whole organism. 

The concept of perseverative consoli- 
dation in learning is an intriguing one. 
The concept in its most general form is 
quite simply stated. When an organ- 
ism practices an action, there continues 
for a time a process which produces 
consolidation of the effects of the prac- 
tice. If this consolidation process is in- 
terrupted or interfered with, by such 
events as a traumatic blow on the head 
or by practice on other similar mate- 
rial, as in the retroactive-inhibition 
paradigm, subsequent performance of 
the act will be deficient as a result of 
the interference. It is hypothesized 
that the action decrement is a direct 
result of the process which produces the 
perseverative consolidation. The bio- 
logical utility of fatigue-like states, in 
this instance, lies in their capacity to 
protect the consolidation process from 
interference. A limited amount of prac- 
tice, in any given instance, is efficacious. 
Beyond that iimit fatigue is accom- 
panied by a modification of the charac- 
ter of the process into some undesirable 
or inefficient form. Such modifications 
would constitute interference with the 
desired response. The fatigue-like state 
permits as much efficacious practice as 
the organism can tolerate without essen- 
tially modifying the character of the 
action system and its associated be- 
havior. 

Sharpless and Jasper (12) point out 
that there is a variety of decremental 
effects which occur as a function of con- 
tinued or repeated stimulation. They 
make several distinctions. Among them 
there is a clear difference between “ha- 
bituation” and “effector fatigue.” For 
them, 
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iaPituation, like learning, is clearly refer- 
ahic ty some form of plasticity in the cen- 

nervous system. . . . It does not de- 
pe. on effector fatigue, since a response 
which has become: habituated to a specific 
stimulus may still be elicited by an appro- 
priate novel stimulus, whereas a fatigued 
effector will fail to respond, not only to the 
repeated stimulus, but to all other stimuli 
of the same relative intensity. 


“Action decrement” is used in this pa- 
per to mean something very similar to 
“habituation” in Sharpless and Jasper. 
It is something like effector fatigue, 
which will accumulate in sufficient 
quantities to eventually modify the 
character of the response, usually in 
some undesirable form. Action decre- 
ment serves to delay or inhibit reactiva- 
tion and thus to protect the consolida- 
tion process from the accumulation of 
effector fatigue to the point of serious 
modification of the character of the ac- 
tion system. Effector fatigue may be 
only one of several mechanisms of in- 
terference and may be chiefly associ- 
ated with overt responses. Effector fa- 
tigue is not thought to be a significant 
factor in any of the situations consid- 
ered in this paper. 

The theory can be restated in a more 
concise, although not as yet in a very 
elegant form. Amy psychological action 
is followed by an action decrement—a 
lowered capacity for rearousal of the 
same event. The action decrement is a 
direct manifestation of the process of 
perseverative consolidation which is nec- 
essary for retention and subsequent per- 
formance. The action decrement per- 
sists for a limited time and then dissi- 
pates. Under many circumstances the 
dissipation of the action decrement is 
followed by an action increment which 
is learning or habit strength. 

The argument at this time is limited 
in the following sense. An attempt will 
be made to present positive, empirical 
evidence for the theory, but no attempt 
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will be made to account for every phe- 
nomenon in every situation in which 
concepts such as reactive inhibition and 
conditioned inhibition have been effec- 
tively and powerfully applied as nega- 
tive factors, or factors antithetical to 
positive learning. 


THE MopEL 


What follows is a verbal model which 
has the potentiality of becoming, un- 
der intelligent modification, a rigorously 
deductive model, a neurophysiological 
model, a mathematical model, or all 
three at once. It is not clearly any of 
these in its present form. 

Perhaps the best introduction is to 
state the problems inherent in what has 
already been said. It is fairly common 
practice to think of perseverative con- 
solidation in terms of reverberatory cir- 
cuits or systems. Reverberatory sys- 
tems have two basic deficiencies, from 
the present point of view. There are 
grave suspicions that reverberatory ac- 
tivity with the initial stimulus as the 
sole impetus could not last as long as 
the consolidation process seems to last. 
Furthermore, one would expect such 
perseveration to present a condition in 
which it is easter to rearouse the action, 
rather than more difficult. That is, if 
some fraction of an action system con- 
tinues in a state of reverberation, the 
threshold for that action should be low- 
ered. It has been hypothesized here 
that the consolidation process is indexed 
by a decrement, a raised threshold. 

Neurophysiological literature contains 
many empirical examples of the after- 
effect of stimulation in systems more 
complex than a single fiber. One ex- 
ample which seems to offer promise may 
be seen in Fig. 1. 

This figure is redrawn from The Neu- 
rophysiological Basis of Mind (1) by 
J. C. Eccles. The data in Eccles are 
taken from a study reported by Eccles 
and Rall in 1951 (2). A monosynaptic 
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Fic. 1. Changes in sensitivity as a function 
of time after stimulation in a monosynaptic 
reflex system. (Redrawn on a log scale from 
Eccles and Rall, 1, 2.) The numbers 1, 18, 
90, and 450 refer to the number of condition- 
ing pulses delivered to nerve to the Flexor 
Longus Digitorum at a rate of 300 per second. 
Ordinate values represent height of test spike 
relative to first spike from conditioning 
stimulus. 


reflex system is prepared in such a man- 
ner that the nerve trunk afferent to the 
reflex can be stimulated, and recordings 
of potentials can be taken on the effer- 
ent side of the synapse. The spike 
height of the first impulse is taken as 
the baseline (100%). The effects of 
any given number of conditioning pulses 
can then be traced by sending in-a test 
pulse after a controlled delay. The 
height of the test spike is then ex- 
pressed as a proportion of the first 
spike produced by the conditioning 
pulse. In the curve labeled “1” it can 
be seen that the second pulse was less 
than the first, if the test pulse was de- 
livered any time during the first three 
seconds after the conditioning pulse. 
Thus there was an output decrement 
traceable for three seconds or more. 
If the conditioning stimulus involved 18 
pulses, in this case delivered at a rate 
of about 300 per second, no decre- 
ment is visible in the graph; but there 
is a period of postsynaptic potentiation 
lasting for at least eight seconds. In 
the curves for 90 and 450 condition- 
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ing pulses, very brief decrements are 
plotted, followed by increments of 150% 
or more. 

There are many reasons why it is 
dangerous to make much use of these 
data: these are motor neurones at 
the spinal cord level, the conditioning 
stimuli are not physiological stimuli, 
they amount to punishment of the fiber 
in a physoiological sense, etc. These 
data are offered only to support the rea- 
sonableness of the following proposi- 
tions. 

1. It is possible that the activation of 
neural tissue results in a decrement in 
output and sensitivity followed by an 
increment. 

2. It is possible that the more in- 
tense the activity, the quicker the re- 
covery, the greater the rate of recovery, 
and the greater the increment or po- 
tentiation. 

These descriptive statements—of suc- 
cessive states of the neural tissue in- 
volved in a particular action and of the 


results of variation in intensity—then- 


form the basis of a model. 

When an animal alternates choices 
between two trials in a T maze, the 
phenomenon can be attributed to a 
decrement in the action system involved 
uniquely in the first choice. The raised 
threshold for this action forces the 
choice of the other alternative on the 
second trial. This situation can be used 
to illustrate and develop the model fur- 
ther. An animal is placed in the maze, 
turns left at the choice point, and is 
then removed. Only a small portion of 
the neural tissue available is assumed 
to have been involved in the action of 
choice, and it seems likely that many of 
the units so involved are fired several 
times in the process. It is possible to 
conceive that these units go into a dec- 
remental phase together, and in a brief 
period, possibly a second or two, re- 
cover more or less together, and then 
rise into a potentiated or supersensitive 
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phase together. This picture would fall 
somewhere between 1 and 18 on the 
Eccles and Rall graph. 

At this point let us invoke the Magoun 
Ascending Reticular System and _ its 
nonspecific cortical input. It is pos- 
sible to conceive of either a rain of 
nonspecific impulses or of rhythmic 
waves of arousal activity at EEG fre- 
quencies as bringing about a refiring or 
recycling of the system after it rises 
into its supersensitive phase. It is ob- 
vious that such a mechanism could in- 
volve only a fraction of the original ac- 
tion system, for the animal does not re- 
peatedly turn left at intervals from a 
fraction of a second to one or two 
seconds. 

Assuming that only a portion, but a 
necessary portion of the system, goes 
through the process, the picture might 
be something like that seen in Fig. 2A, in 


«Theoretical Course of Sensitivity of Action System 
m an Individual Organism 
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Fic. 2A. Theoretical recycling pattern for 
an action system driven by nonspecific input 
originating from a low drive state. 

Fic. 2B. Theoretical recycling pattern un- 
der a higher drive state. 

Fic. 2C. Theoretical recycling pattern un- 
der a low drive state with reward introduced 
after the third cycle. See text for explanation. 
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which the choice response is assumed to 
have occurred at the left. The fraction 
of the system goes into a decremental 
phase, and recovers into a potentiated 
phase. When it reaches an appropriate 
level, nonspecific input originating in 
some part of the reticular system can 
become effective in rearousing a frac- 
tion of the original action system, which 
then goes into a second decremental 
phase. This iterative process might 
well recur many times. 

A further step involves the effects of 
different levels of motivation. Suppose 
one were to assume, as does Hebb (4), 
that differences in motivational level 
correspond in some way to differences 
in nonspecific output from the reticular 
system. According to the descriptive 
statement relative to the effects of in- 
tensity drawn from Eccles and Rall, 
one would expect an increase in the 
level of nonspecific input from an in- 
crease in motivational level and thus an 
increase in the intensity of the original 
action or any subsequent cycle of it. 
This would produce a quicker recovery 
in absolute time, a steeper curve of re- 
covery, and a greater potential incre- 
ment. Figure 2B illustrates the effect 
of a higher level of motivation on the 
shape of the cycle and the rate of itera- 
tion. 

A final step involves an assignment 
of a role for reward within the model. 
Consideration leads to the conjecture 
that any reward condition might pro- 
duce an increase in the level of non- 
specific input, very much as if the level 
of motivation had been raised to a 
higher value. This condition is pic- 
tured, theoretically, in Fig. 2C, where 
reward is assumed to have been intro- 
duced after the third cycle. This effect 
of reward would fit the results of brain 
stimulation studies as reported by Olds 
and Milner (11), and as summarized 
by Olds (10). An implanted electrode 
with its tip in various parts of the brain 
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can produce approximately the same ef- 
fect on behavior as does water reward 
to thirsty animals. Both are concep- 
tualized here as producing increases in 
the level on nonspecific input. 

There are at least two factors which 
might cause this recycling process to 
cease. The integrity of the action sys- 
tem is dependent upon the condition 
that all units are originally fired at ap- 
proximately the same time. At each 
recycling, a certain number of units 
could be expected to be lost because 
they did not recover in time to partici- 
pate in the next recycling. Thus the 
size of the action system would grow 
progressively smaller through a process 
of fractionation. Furthermore, such a 
system has to some degree an afferent 
and an efferent end. One might con- 
ceive of the recycling process as being 
progressively restricted to the more ef- 
ferent end. Both factors could be ex- 
pected to produce a progressive decrease 
in the correlation between the excit- 
ability cycles of the units of the action 
system. The system would be con- 
ceived to have lost its dynamic in- 
tegrity. and no further consolidation 
would occur from the moment when the 
correlation between the units reaches 
zero. When a unit drops out of the 
system, it can be expected to recover 
rather quickly to a semipermanent state 
of slightly lowered threshold, and when 
all perseverative activity has stopped, the 
combined threshold changes will consti- 
tute an increment in habit strength. 

Certain characteristics of the model 
should probably be noted at this point. 
It describes a hypothetical pattern of 
behavior for a population of neural 
units which involve time units of the 
order of seconds. It may eventually 
be possible to derive this model from 
one which describes the behavior of in- 
dividual units in time units of the or- 
der of milliseconds. Second, it will be 
noted that the burden of perseveration 
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Theoretical Course of Action System in an Individual Organism 
in Terms of Probability 
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Calculated probabilities of repetition for a nonreinforcement condition (from Fig. 2A), 


and from a reinforcement condition (from the latter part of Fig. 2C). 


is in large part carried by the states of 
the units involved, where the state is a 
function of the original condition and 
the effect of the action. Thus, while 
perseverative recycling might be ex- 
pected to be wiped out by electrocon- 
vulsive shock, it might well survive cool- 
ing in a hibernating animal. Cooling 
might slow or even stop the recycling 
process, but subsequent warming might 
_ bring it back into a perseverative con- 
dition. Finally, the model at this point 
is largely deterministic. At the next 
most molar level it becomes a prob- 
abilistic model. 

Probabilities become factors in the 
model in several ways. As an action 
system rises into a potentiated phase, 
the precise point of recycling is subject 
to more or less random variation. Fig- 
ure 2 might well have been drawn with 
different degrees of potentiation before 
recycling. Had this been done, there 
would have been an irregularity in the 


heights reached by the individual cycles, 
and there would have been a resulting 
variation in the time consumed by each 
cycle. Much more important, however, 
is the problem of the state of the sys- 
tem at the moment when the organism 
makes a second choice. If the system 
is in decrement, then the organism 
should choose the previously unchosen 
alternative. If it is in an incremental 
or potentiated phase, the choice should 
be to repeat the original choice. Since 
the time intervals involved in a single 
cycle in Fig. 2 should be in the general 
range of a second, and since experi- 
mental situations employed so far do 
not permit time control with any pre- 
cision at this time range, the state of 
the system on the occasion of a second 
choice should be essentially a random 
sample of the available conditions. The 
prediction of what an animal will do on 
the occasion of a second choice can only 
be expressed in terms of probabilities. 
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The probability of repetition should be 
quite close to the ratio of time in a 
decremental state to time in a potenti- 
ated state. In Fig. 2A this ratio is 
150:50, yielding a probability (p) of 
repetition of .25.. In Fig. 2B and in 
the latter part of Fig. 2C, the ratio is 
163:37, yielding a p value of .185. 
Thus the initial p values plotted in 
Fig. 3 are derived directly from Fig. 2. 

In Fig. 3 the assumption is made 
that as long as any part of the action 
system is in an active state, as por- 
trayed in Fig. 2, the probability of 
repetition will remain at a fixed value. 
When the active phase comes to an end, 
this p value will rise to a level slightly 
higher than it was before the activation 
of the system occurred originally. Ob- 
viously, repeated activation will lead 
eventually to a p value of nearly 1.00. 

It is interesting to note that Fig. 3 
conforms to the hypothesis previously 
stated by Walker (14) that the greater 
the decrement, the quicker the recovery 
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and the greater the eventual increment 
(learning). In Fig. 1 the quick re- 
covery and the greater increment are 
associated with the smaller apparent 
decrement. Thus one of the three cor- 
related propositions is inverted in the 
process of transition from the determin- 
istic level to the probabilistic one. 

It is tentatively assumed that the 
amount of the decrement, the time re- 
quired for recovery from the active 
phase, and the height of the increment 
will all be proportionally related. What- 
ever influences one will have a propor- 
tional effect on the other two. This 
should not only be true of experimen- 
tally manipulated variables such as level 
of motivation and amount of reward, 
but should describe individual differ- 
ences between organisms as well. That 
is, if, under the same experimental con- 
ditions, two organisms show different 
probabilities of repetition during the 
decremental phase, the one with the 
lower probability of repeating should 
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4 is an approximate smooth fit to these data 


show quicker recovery and a greater 
increment of habit strength from a sin- 
gle trial. Since there is no immediately 
apparent way to assess the probability 
of repetition in a single organism, it is 
necessary to assume an essentially nor- 
mal distribution of individual differ- 
ences in probabilities; this permits cal- 
culation of the percentage of animals 
which can be expected to repeat at any 
given moment in time after a first 
choice of two alternatives. Figure 4 de- 
picts this expectation. 


EMPIRICAL EVIDENCE 


The Duration of the Action Decrement 
and the Effect of Reward 


The duration and course of the action 
decrement have been traced in an al- 
teration study in a T maze (14). There 
were two groups of thirsty animals. 
One received water in both goal boxes; 
one group received no water. Each ani- 


mal was given a single pair of choices 
on a given day, with the time between 
Twenty- 
ranging 


choices carefully controlled. 
one different time intervals, 


from about 80 seconds between trials to 
something over four hours, were in- 
vestigated; there were 21 animals per 
point. The model, as specified, pre- 
dicted two things. 

First, it had previously been thought 
that action decrement, at least under its 
other names, would dissipate as an ex- 
ponential function of time. The model 
suggested that the decrement would be 
sustained for a period without appre- 
ciable loss as a function of the recycling 
process, and then recovery would occur. 

Second, when the reward and nonre- 
ward conditions were compared, it was 
expected that there would be a greater 
tendency to alternate in the reward 
group. This would be followed by a 
quicker recovery and then, after suffi- 
cient time, by a greater tendency to re- 
peat, as a function of the habit strength 
acquired in a single trial. It should be 
noted that there is something a little 
nonsensical about this. A greater tend- 
ency to alternate in the rewarded ani- 
mals would mean that if two thirsty 
animals turn left on the first trial, and 
if one is rewarded with water and the 





AcTION DECREMENT 


other is not, the rew7rded animal should 
have a greater to turn the 
other way on the subsequent trial. But 
on the basis of acquired habit strength, 
alone, it should have a greater tendency 
to repeat its first choice at all times. 
The results may be seen in Fig. 5. 

The expectation of a sustained decre- 
ment seems to be borne out by these re- 
sults. There is a greater tendency to 
alternate (or lesser tendency to repeat) 
in the rewarded animals in the early 
stages. The quicker recovery for the 
rewarded group is suggested, but no 
more, and the habit strength from a 
single reward could not be demonstrated 
with the time and resources available. 
The theoretical curves in Fig. 4 are 
actually a smooth fit to the data in 
Fig. 5. The general form of the two 
curves and the relation between them 
were established prior to the experi- 
ment, but there was no way to suggest 
appropriate repetition percentages or 
time values. 

These results seem to provide partial 
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support for the theory and are certainly 
somewhat difficult to explain from a 
more traditional point of view. 


Motivation and Alteration 


The effort to deal with motivation has 
not been quite as successful as the ef- 
fort to deal with reward. One previ- 
ously unpublished study has been car- 
ried out using a shock grid throughout 
a T maze, with the goal boxes shock- 
free. A high level of shock (40 volts) 
was applied to the animal (his feet had 
been dipped in saline solution) through- 
out two trials. It was hoped to show a 
greater tendency to alternate than in 
the thirst and reward study, quicker 
recovery, and a greater increment in 
habit strength. There are only four 
points plotted in Fig. 6. The decre- 
ment is greater than in the previous 
study, but the recovery rate seems 
faster, since both of the middle points 
are out of the population of points in 
the thirst-reward study. The final point, 
at 24 hours, does not constitute a sig- 
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nificant demonstration of habit strength 
from a single trial. 


Amount of Decrement and Ease of 
Learning 


A very different kind of study emerges 
from a restatement of the theory in the 
following way. Amy factor capable of 
producing a big decrement should be 
capable of producing a big increment 
or rapid learning. 

The background for this experiment 
by ‘Walker and Paradise (17) begins 
with a study by Glanzer (3), and a 
nearly identical one by Montgomery 
(9). Both reasoned that when an ani- 
mal alternated in a T maze, one could 
not tell whether it was now turning 
right because it had previously turned 
left, or whether it now went to the 
white side because it had tried the 
black side the last time. Both built 
+ shaped mazes that could be used as 
T mazes from either top or bottom by 
closing off one starting alley. If an ani- 
mal is given a trial from one end and 
turns left to the black, and if his second 
trial is from the other starting alley, he 
can now alternate responses and turn 
right to the black, or repeat his left 
turn and alternate stimuli to go to the 
white, but he cannot alternate with re- 
spect to both stimulus and response. 
Both Glanser and Montgomery found 
alternation with respect to stimuli, and 
virtually none with respect to response. 

Subsequently, Walker, Dember, Earl, 
and Karoly (15) went a step further, 
placing the + maze on wheels; with a 
somewhat more complex design they 
were able to offer animals a choice of 
alternation with respect to all three— 
stimulus, place, and response, or any one 
against the other two. It was found 
that stimulus was most important, and, 
by implication, was producing the great- 
est action decrement; place was next 
most important; and response was last. 

Following that study, it was reasoned 


Epwarp L. WALKER 


that the response could be made a sig- 
nificant factor in alternation if the feed- 
back from the two responses was quali- 
tatively very different. To accomplish 
this, a slightly modified + maze, called 
the side-winder or the contortion maze, 
was built. The animal was required to 
twist in three dimensions to enter the 
goal alley, and the responses to the two 
sides required two very different move- 
ment patterns. The previous design 
was now repeated by Walker, Dember, 
Earl, Fawl, and Karoly (16), and it 
was found that the response was now a 
considerable factor in alternation. 
Since three factors could be combined 
or separated in the original (horizontal 
maze, H), and since there were four 
estimates of the differential capacity to 
produce alternation in the side-winder 
(vertical maze, V), there were available 
eight conditions which differed in their 
capacities to produce alternation. By 
inference, they differed in the relative 
depths of action decrement they pro- 
duced. By hypothesis, they should dif- 
fer in the same order in their efficacy as 
cues in learning. Therefore, eight learn- 
ing conditions, four in each maze, were 
set up. In one condition in each maze, 
the reward remained with the same 
stimulus, the same place, and the same 
response, all at the same time (SPR-H 
and SPR-V). In another, the reward 
followed the stimulus, but was random 
with respect to response and place (S-H 
and S-V). In the third, the reward re- 
mained in a place, but was random with 
respect to the stimulus and response 
(P-H and P-V). In the fourth, the re- 
ward followed the response, but was 
random with respect to the stimulus 
and place (R-H and R-V). The re- 
sults, with eight animals in each group, 
are shown in Fig. 7. The top figure 
shows the percentage of repetition (the 
reverse of alternation) found to each of 
the eight factors in the previous studies. 
Thus the letters SPR-V indicate that, 





AcTION DECREMENT 


PER CENT REPETITION 





> > F 


o « 


CONDITION 


Vs 
Vb 


TO LEARNING CRITERION 
Wd 
Wb 
Yb: 


Vdd 


77 
hb 





\Yi 
‘Wht 
Wb 
V6: 
‘Ye 
VJ) 


DAYS 
R-H 
P-V 


SPR-V 
SPR-H 
S-H 
S-V 
R-V 
P-H 


° 
° 
z 
g 
7 
°o 
z 


w 
c 
o 
c 
c 
Ww 
oo | 
<a 
— 
°o 
z 
<a 
Ww 
= 








a. =. So 
o oo & a 


= ? 
« a 
CONDITION 

Fic. 7. Empirical test of proposition that 
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when the animal was permitted to al- 
ternate with respect to all three in the 
vertical maze, there was very little tend- 
ency to repeat a choice but a great 
tendency to alternate, and thus a very 
large action decrement. On the other 
hand, the letters P-V mean that in the 
vertical maze, when the animal was of- 
fered an opportunity to alternate stimu- 
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lus and’ response by repeating place, 
there was a strong tendency to repeat 
place, and, by inference, little action 
decrement. 

The middle figure shows the number 
of days required to reach a criterion of 
learning in each of eight conditions. 
There are eight trials per day under 
thirst with water reward, and the cri- 
terion is 15 correct choices in 16 trials. 
The lower figure indicates the mean 
number of errors in each group. The 
fit is reasonably close and, to the ex- 
tent that it is close, supports the theory. 


Action Decrement, Stimulus Trace, and 
Perseverative Consolidation 


It was asserted earlier that the proc- 
ess being tracked when one measures 
action decrement is perseverative con- 
solidation. It also seems essentially 
true that a stimulus trace and a mem- 
ory trace involve essentially the same 
mechanism. It was for this reason that 
the basic hypothesis of this paper was 
cast in terms of “any psychological ac- 
tion.” This process consists of a pro- 
gressive loss of members of the original 
population of neural units involved in 
the action. 

According to the present hypothesis, 
the occurrence of the event in question, 
whether a presentation of a conditioned 
stimulus or a learning trial, serves to 
correlate the sensitivity cycles of a 
population of neural units. Driven by 
nonspecific input, a part of the system 
thus created goes through a neurally 
active, iterative, recycling process. At 
each cycle some of the original popula- 
tion of neural units is lost. The rate 
of loss will determine the duration of 
the active phase and the form of any 
measure of the effectiveness of the trace 
at any given point in time. 

The form of such a trace is certainly 
a “simple decay function,” as suggested 
by Hull (5) in 1943, and in certain in- 
stances is well fitted by a power func- 
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Trace Conditioning 
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LOG SECONDS 
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Fic. 8. Two measures of rate of learning of 
a trace-conditioned avoidance response with 
four different CS-US intervals. Data taken 
from Kamin (8), and drawn on a log abscissa 


tion, as indicated by Hull (6) in 1950. 
Kamin (8) has recently reported data 
on trace conditioning in dogs. He used 


CS-US intervals of 5, 10, 20, and 40 
seconds, and reported a variety of meas- 


ures of learning and extinction as a 
function of the duration of the trace. 
Certain of his measures of rate of learn- 
ing seem to approximate a straight line 
when plotted on a log abscissa, as may 
be seen in Fig. 8. These particular 
measures were selected from several re- 
ported by Kamin, since it seemed likely 
that they were least affected by the fact 
that two animals in the 40-second group 
failed to learn to criterion. 

What appear to be the least am- 
biguous results on the rate of decay of 
a memory trace or learning trace are 
those reported by Thompson and Dean 
(13). Following a learning trial, each 
recycling of the action system is con- 
ceived of as contribution to the habit 
strength acquired on that trial in pro- 
portion to the number of the original 
neural units remaining in the system in 
that cycle. If one should interrupt the 
recycling process at any given time 
after the learning trial, the amount of 
habit strength laid down by that trial 


should be describable as a linear func- 
tion of log time between the trial and 
the interruption. 

Unfortunately, it is extremely difficult 
to demonstrate the quantity of habit 
strength acquired on a single trial, and 
therefore even more difficult to demon- 
strate that a portion of that amount 
was lost through a given interruption. 
However, training can be massed so 
that one trial follows another in rapid 
succession and a large number of trials 
forcibly reactivate the action system 
without appreciable decay between trials. 
Under these conditions, a sufficient quan- 
tity of potential habit strength can be 
built up so that one would expect dem- 
onstrable differences in perseverative 
consolidation as a function of the in- 
terval between the end of training and 
the interruption. If the memory trace 
behaves as does the stimulus trace in 
the Kamin study (Fig. 8), then the 
amount of habit strength should be a 
linear increasing function of log time. 
Since the action decrement seemed to be 
virtually at an end after four hours in 
the Walker study (14), the theoretical 
curve in Fig. 9 is plotted to that point 
(see Figs. 4 and 5). 

The study by Thompson and Dean 
(13) has the following character. They 
used a very simple maze with a starting 
box and a small V shaped choice cham- 
ber with two windows at the end, sepa- 
rated by a small board projecting out 
three inches from the window wall. 
They prehandled their animals for sev- 
eral days, and then, in preparing them 
for the critical learning period, taught 
them a simple grayness-discrimination 
problem for three days. They were 
motivated by shock applied if they 
stayed in the starting box more than 5 
seconds or if they failed to choose a 
window after more than 30 seconds. 
There is no statement of how many 
shocks were required or through how 
much of the training period shocks 
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Data 


taken from Thompson and Dean (12), and replotted here on a log abscissa 


were continued. Finally, Thompson 
and Dean gave their animals massed 


training on an easy horizontal-vertical 


problem. Each animal was trained on 
this problem in the shortest possible pe- 
riod of time; an average of about 28 
minutes seems a likely estimate from 
their description. One group of such 
animals was given electroconvulsive 
shocks 10 seconds after the end of this 
training, another group was shocked 
two minutes after training, a_ third 
group one hour after training, a fourth 
group four hours after training, and a 
control group was not subjected to 
shocks. Forty-eight hours later they 
were retrained, and the relative savings 
in relearning were computed. 

The results may be seen in Fig. 9. 
The dotted line is the theoretical pre- 
diction. The solid one is a replot of 
the error results reported by Thompson 
and Dean, now placed on a log scale. 
The apparent closeness is probably ad- 
ventitious. From the theory, one would 
expect the duration of the action decre- 
ment to vary widely with the relative 


ease or difficulty of the problems pre- 
sented, with the type and level of mo- 
tive, with the magnitude and delay of 
reward, and with many other factors. 
The Walker study (14), on which the 
theoretical curve is predicated, and the 
study by Thompson and Dean (13) 
differed on all of these dimensions. 
Either the period of decrement and 
perseverative consolidation is much less 
subject to variation through the ma- 
nipulation of these variables, or the 
closeness of fit in Fig. 9 is a most 
happy pair of combinations of variables. 

In summary, it can be argued that 
there is some merit to the position that 
the action decrement represents a trace 
of the perseverative consolidation proc- 
ess, that it is thus positively related to 
learning, at least in some instances, and 
that one can expect operations which 
produce rapid learning to produce great 
decrements. Wherever it is applicable, 
this theory is in complete contradiction 
to the position that the fatigue-like dec- 
rement is detrimental to or antithetical 
to habit strength and learning. 
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Much of what has been written on 
the subject of psychological theory con- 
struction, both on the part of psycho- 
logical theorists and on the part of the 
philosophers of science, has been di- 
rected to the analysis and determination 
of the nature and function of the con- 
cepts which are found in such theore- 
tical systems. The emphasis seems to 
have centered on the refinement of the 
methodology by which such concepts are 
formed, and on the meaning status of 
the constructs as they function in the 
system. Thus, operationism and the 
constructural method have received ex- 
tensive treatment. They provide the 


method and the meaning for a scientific 
psychology. 


Careful examination of the current 
psychological systems will reveal certain 
conceptual elements which function in 
the formulation and application of these 
theories, but which do not fall under the 
aegis of the formally defined and ac- 
cepted methods by which the systems 
have been constructed. This paper will 
attempt to indicate some of these non- 
constructural aspects, and briefly dis- 
cuss one or two of the implications that 
flow from them. 

Obviously, there are nonsystematic, 
nonscientific, nonconstructural opera- 
tions and processes that enter into the 
construction of a theoretical system by 
way of necessary preliminaries. The 
scientist must read instruments, take 
measurements, feed rats, and a thousand 
other things, which are not directly in- 
corporated into his theory, but which 
provide the data from which he will 
ultimately construct his system. We 
are not concerned with these pretheo- 


retical elements. But we are concerned 
with other nonconstructural aspects 
which reveal themselves in the very con- 
struction and application of the theo- 
retical constructs themselves, and may 
even alter the meaning of the theoretical 
concepts. 

Our investigation will focus on three 
such nonconstructural elements: the at- 
tribution of real existence (as a real 
part of the organism) to theoretical 
constructs, the theoretical assumption of 
the construct as a quasi-real struc- 
ture for purely methodological purposes 
(without asserting its real existence in 
the organism), and lastly, the experi- 
ential reinterpretation of theoretical con- 
cepts which have been previously de- 
fined formally by systematic methods. 

Since the appearance of Bridgman’s 
introduction of the concept of the opera- 
tional definition into the methodology 
of psychology, psychological theorists 
have been deeply concerned over the 
adequacy of operationally defined con- 
structs to function as descriptions of 
psychological phenomena (12). Bridg- 
man’s explicitation of the operational 
method focused attention on the char- 
acter of the constructions which were 
related to any given complex of opera- 
tions. Tolman (32, 33) identified and 
used the intervening variable as a type 
of construct mediating operationally de- 
fined variables. Although he seems to 
have intended the intervening variable 
as a purely functional and relational 
concept, it is not clear that this purely 
relational concept did not turn out to be 
something quite different (31). 

The effort of MacCorquodale and 
Meehl (19) to clarify the terminology 
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applied to these constructions was a 
start in the direction of identifying the 
kinds of concepts which could function 
in a psychological theory. They dis- 
tinguished the intervening variable from 
the hypothetical construct. The inter- 
vening variable was an abstract, em- 
pirical relation, which merely served 
to organize lower level empirical laws. 
The hypothetical construct, however, in- 
volved some supposition of entities or 
processes, which were not directly ob- 
served, and therefore were not included 
in the original definitions. Essentially, 
this “surplus meaning” was taken to be 
the implication of the existence of en- 
tities and the occurrence of events in 
the real subject of investigation. How- 


ever, it seems that this interpretation of 
hypothetical constructs and their “sur- 
plus meaning” is rather limited and has 
led to a certain amount of unnecessary 
confusion. 

Supposing for the moment that “sur- 
plus meaning” has reference primarily 


to the suggestion of existence (it may 
signify other things),then what inter- 
pretations can be put on this “exist- 
ence”? In the original sense of real 
existence, as suggested by MacCorquo- 
dale and Meehl, there is necessary a fur- 
ther distinction. “Real existence” of an 
inferred entity can be taken as meaning 
that the inferred entity, as formally un- 
derstood, really exists as part of the 
intrinsic, objective, noninferred, real 
structure, which constitutes the object 
of investigation. Or, the “real exist- 
ence” of an inferred entity can be un- 
derstood to mean only that the construct 
is formed and intended as a theoretical 
correlative of the real structure of the 
object. In this sense, a hypothetical 
construct is said to denote (10). Lind- 
zey (18) has expressed the need for this 
sort of clarification in his attempt at the 
description of what he termed “conven- 
tional constructs.” This type of con- 
struct involves an inference about the 
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reality of the organism no less that any 
hypothetical construct—but it is pre- 
cisely an inference about the organism 
as it is known in the theory. It is not 
an inference about the real structure of 
the organism itself. The former sense, 
if found in the formulation and inter- 
pretation of psychological theories, con- 
stitutes a gross misunderstanding of the 
nature of theoretical constructions, as 
well as a misapplication of methodology. 
The reasons for this will be discussed 
below. The latter sense, however, is a 
legitimate systematic concept, and is the 
only acceptable and possible meaning of 
“real existence” as applied to hypotheti- 
cal constructs. Since this sort of “sur- 
plus meaning” is not found in the con- 
structed definition of the concept, how- 
ever, it is a nonconstructural element 
within the framework of the theory. 

This theoretical-real existence must 
not be confused with the kind of exist- 
ence which is applied to a construct 
by reason of its contextual consistency 
within the framework of its proper 
theory. This sort of “existence” is 
nothing but the coherence of logical re- 
lations among the constructural concepts 
which compose the theory. The logical 
coherence of constructs in a theory can 
not be taken as indicative of any- 
thing beyond the theory itself. This 
sort of systemic existence (1) is com- 
mon to both intervening variables and 
hypothetical constructs. The “surplus 
meaning” involving “real existence” of 
hypothetical constructs must be reserved 
to theoretical-real existence in the latter 
sense of a theoretical correlate described 
above. 

The failure to recognize this distinc- 
tion between meanings of real existence 
has led to a reconfusion of terminology 
(25). The supposition of theoretical- 
real existence has sometimes been as- 
similated to the intervening variable 
(22, 23), with the result that the in- 
tervening variable is no longer merely 
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intervening, and the hypothetical con- 
struct is reduced to the level of a pre- 
liminary and imperfect stage in the de- 
velopment of a fully operational theory 
based on the intervening-variable type 
of construct alone. If Feigl’s “existen- 
tial assumption” can be interpreted in 
this sense of theoretical-real existence, it 
would seem that this plea for the return 
of the hypothetical construct is funda- 
mentally an appeal to this sort of dis- 
tinction in the meaning of “real exist- 
ence” (7, 8, 9). 

Correlative to the issue of real exist- 
ence is the question of the conceptual 
status of constructs and constructural 
models as they function in theory. The 
issue of the legitimacy or illegitimacy of 
the flat assertion that theoretical entities 
have real existence will be decided in 
terms of our understanding of the na- 
ture of these concepts. There is no 
question of the legitimacy of construc- 
tural concepts, but only of the assertion 
of their existence. Generally speaking, 


methodologists are aware that a theo- 
retical model can not be understood as 
representative of the real structure of 
some real entity (28,31). This is fairly 
obvious in the case of the intervening 
variable, whose characteristics are of a 


purely formal nature. But in the case 
of the hypothetical construct, where 
some sort of objectivized (not objective) 
structure is implied, the issue is raised 
again and again. 

A correct appraisal of the nature of 
constructural methodology has led many 
theorists to evaluate the legitimate “sur- 
plus meaning” (i.e., theoretical-real ex- 
istence) of the hypothetical construct as 
an extrasystematic and, therefore, non- 
constructural element, which introduces 
an impure fraction into the constructural 
purity of the theory. However, the sur- 
plus enters into the understanding of 
such a construct only to the extent that 
the construct itself is structural (15). 
The hypothetical construct differs from 
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an intervening variable precisely in this, 
that it hypothesizes some sort of struc- 
ture to explain the relation of lower- 
level variables (25). Obviously, a sci- 
entist can not think of structure, as op- 
posed to a merely formal or mathe- 
matical function, without thinking of it 
in terms of “theoretical-real existence.” 
This does not imply anything about the 
real structure of any real thing, but it 
does imply that the theorist is thinking 
of this construct as an analogue to the 
real structure of a real thing. 

Theoretical models must be thought 
of then as research tools, which the 
theorist forms without direct dependence 
on or inference from the immediate data 
of experience. The constructural-theo- 
retical model is related to the ultimate 
real structure of the thing under in- 
vestigation through a complex set of 
relations, which involve certain speci- 
fied methodological procedures, selective 
processes, and measurement techniques. 
The point here is that theoretical con- 
structs are not directly tied down or de- 
termined by the real structure of their 
objects. If they were so tied to the 
structure of the thing, there would be 
little room for the multiple hypothetical 
models we find in psychology, nor could 
the theorist enjoy the relative freedom 
in structuring the model that is now his. 
It is for this reason that the assertion of 
the noninferred real existence of such 
theoretical entities must be looked upon 
as illegitimate. 

Models should not really be thought 
of as primarily imitative, but rather as 
a sort of adaptable pattern which can 
be compared with the available data of 
experiment to find out what adaptations 
are to be made and in what direction 
the course of our investigation must be 
turned (21). Although it is not clear 
to me what the criteria of usefulness are 
to be in the development of a psycho- 
logical theory, the recent emphasis on 
“usefulness” of theoretical constructs, 
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at least for the formulation of research 
hypotheses, marks an encouraging shift 
from the former preoccupation with 
reality (30). Even on logical grounds, 
it has been pointed out (20) that the 
common procedure of testing theories by 
inference and confirmation is open to the 
possible fallacy that the consequence 
is unique for that theory. If Conse- 
quence B is deduced from Theory A and 
experimentally confirmed, we have added 
to the probability of Theory A; but we 
cannot assume that the same Conse- 
quence B may not be implied by some 
alternative theory. The hypothetical 
construct is a surrogate or symbol which 
is constructed in the theorist’s mind as 
a substitute for the real structure of the 
organism, and which is only indirectly 
related to the structure of that organ- 
ism. The whole direction or impulse of 
theory construction is to the progressive 
formulation of better theoretical con- 
structions which are capable of more 
rigorous evaluation and which will grad- 


ually converge on the real structure of 
the organism (24). 
Feig] (6) has expressed the belief that 


higher-order hypothetical constructs, 
which are built on and constructed from 
operations, will gain real insight into the 
natures of things. But in a later writ- 
ing (8), he recognizes that the meaning 
of a psychological concept is generally 
not identical with its defining operations. 
If we are able to speak of insight into 
the natures of things (whatever that 
may mean in the context of construc- 
tural theory), whatever meaning is con- 
tained in higher-level constructs must be 
reflected in the lower-level definitions in 
terms of observable data. If meaning 
and definition are not identical, we must 
explain the difference. I do not mean 
that we must explain the fact of a dif- 
ference, but we must define the differ- 
ence. Otherwise our procedure is un- 
scientific and methodologically unsound. 

Along this same line, Krech (17) has 
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pointed out that hypothetical constructs 
could not function in a purely psycho- 
logical psychology, since the purely psy- 
chological data are beyond the reach of 
scientific inquiry. Because the experi- 
ence of a private datum is an unveri- 
fiable event, and because science is con- 
cerned only with verifiable events, some 
would claim that a scientific psychology 
of private experience is a contradiction 
(32). Either psychology proceeds be- 
havioristically and is a science, or it 
treats of the private datum and relin- 
quishes its claim to scientific status (4). 
Thus Krech has indicated that the con- 
cepts of tensions, needs, and cognitive 
structures are sometimes defined as hy- 
pothetical constructs, and sometimes as 
conscious experience or behavior (17). 
This means that there has been a shift 
in the formal meaning of these concepts, 
and we are dealing with two concepts 
instead of only one. One is a formally 
defined hypothetical construct, which 
functions as an integral part of a theory. 
As such, it is linked to the observable 
data, from which it is structured, by 
low-level empirical laws and operational 
definitions. The other concept, which 
represents the redefinition of the previ- 
ous hypothetical construct in terms of 
experience, is more difficult to delineate 
because of the fact that it is rarely, if 
ever, given any sort of explicit or formal 
presentation. However, in general, it 
seems to take the form of a subtle re- 
interpretation of a previously defined 
concept in terms of some sort of phe- 
nomenological experience. This sort of 
shift in meaning has been pointed out as 
due to a failure to distinguish between 
the operational meaning of intervening 
variables or hypothetical constructs and 
the intuitive properties ascribed to them 
(14). 

This shift in the interpretation of con- 
cepts must not be confused with the 
possible shift that sometimes occurs in 
the construction of theoretical systems 
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between intervening variables and hy- 
pothetical constructs. It has sometimes 
happened that a concept is defined and 
constructed as a purely functional inter- 
vening variable, but later in the develop- 
ment of the theory it acquires a denota- 
tive meaning and a certain amount of 
structural connotation, which qualifies 
it as a hypothetical construct (10). 
Both Tolman (26) and Hull (10, 19, 
25, 27) have been accused of permitting 
this subtle reorientation in the mean- 
ing of their concepts. Very likely, 
Bergmann’s dismissal of the distinction 
between intervening variable and hy- 
pothetical construct as a pseudodistinc- 
tion (3) stems from insufficient atten- 
tion to the possibility of this sort of 
subtle shift in the formal meaning of 
concepts. 

As long as the surplus meaning, which 
constitutes the concept as a hypothetical 
construct, involves no more than the as- 
sumption of theoretical-real existence, 
the procedure is by no means illegiti- 
mate, and can be scientifically fruitful. 
It is this sense, I believe, that Feig] has 
spoken of “existential assumptions” (7, 
8). However, if the surplus meaning in- 
volves the implication of real existence 
(involving attribution of the hypotheti- 
cal construct to the organism as part of 
the real structure of the organism), the 
connotation is illegitimate and unscien- 
tific, as we have already pointed out. 
There seems to be a certain amount of 
evidence to suggest that Hull was not 
always able to avoid this error. In re- 
gard to the sHr, he wrote that “it exists 
as an organization as yet largely un- 
known, hidden within the complex struc- 
ture of the nervous system” (11, p. 
102). Likewise, MacCorquodale and 
Meehl were quick to suggest that Hull’s 
early articles on conditioning were writ- 
ten because Hull “considered that the 
hypothetical events represented in his 
diagrams may have actually occurred 
and that the occurrence of the events 
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represents the underlying truth about 
the learning phenomena he dealt with” 
(19, pp. 104-105). 

In our discussion thus far, we have 
seen that this sort of implication of the 
real existence of an inferred entity as a 

art of the real structure of an organism 

is extrasystematic and to that extent, 
nonconstructural. This also constitutes 
an illegitimate inference, which is not only 
not supported by the defining method, 
but is contrary to the very nature of 
the scientific constructural methodology. 
We have also seen that the theoretical 
assumption of the constructed concept 
as correlative, and perhaps suggestive of 
the real structure of the organism, is 
again extrasystematic and nonconstruc- 
tural, but in this case the assumption of 
existence (which is equivalently an as- 
sumption of monexistence) is entirely 
legitimate, and in fact a necessary cor- 
relate of the development of theoretical 
concepts. We have further suggested a 
third kind of nonconstructural ingredi- 
ent which seems to function in psycho- 
logical theory: the reinterpretation of 
systematically constructed concepts in 
terms of experiential variables. This last 
nonconstructural aspect deserves further 
consideration. 

Spence (31) has already pointed out 
that the method of field theorists like 
Lewin depends heavily on phenomeno- 
logical introspection for the introduction 
of theoretical concepts. If these con- 
cepts are then defined systematically in 
terms of given observables, they func- 
tion as integral parts of a scientifically 
constructed theory. But, if they con- 
tinue to be applied and interpreted in 
terms of the original experiential con- 
text in which they arose, they constitute 
something else by way of formal con- 
cepts. It is quite possible that the cor- 
relation of empirical constructs with 
formal terms according to the logic of 
dynamics, as Koch (16) has analyzed 
them in Lewin’s system, presents a dif- 
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ficulty precisely in so far as the em- 
pirical constructs are functioning at a 
phenomenological level and the formal 
terms are presented at a constructural 
level. 

An example may help to clarify the 
problem. Hull (11) introduces his 
concept of habit strength as a func- 
tional stimulus-response relation between 
stimulus energy, response, nature and 
number of reinforcements, and the re- 
action potential, which is measured in 
terms of the actual response. This in- 
tervening-variable type of concept is 
then conceived as a dynamic relation- 
ship between the afferent and efferent 
neural impulses. This seems to be more 
of a hypothetical construct, but the defi- 
nition of the term is still couched in sys- 
tematic and operational terms, and the 
switch from intérvening variable to hy- 
pothetical construct is still acceptable. 
However, at one point Hull tells us that 
“it would appear that the presence of 
internal conditions or neural organiza- 
tions, such as habit structures (sHr) 
and reaction potentials (sEr) are also 
reportable” by introspection (13, p. 
344). He is also explicit in stating his 
conception of receptor-effector connec- 
tions in terms of common sense habits 
(11). If Hull is able to identify these 
constructs by introspective methods, it 
follows that the concept, as operation- 
ally defined and identified, is now being 
reinterpreted and reidentified in terms 
of experiential elements which are not 
included in the systematic formulation 
of these concepts. Phenomenological 
introspection is not restricted to field 
theorists alone, so it seems. 

The introduction of these noncon- 
structural elements into even the most 
sophisticated of behavioral systems 
raises a serious question. Snygg (29) 
has raised the issue of a phenomenologi- 
cal psychology. But, like Tolman (32) 
before him, he draws the line between 
the phenomenological and the objective 
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in such a way as to give us a none too 
happy choice. Are we forced to make 
such a choice? The scientific method, 
as it has been transferred from natural 
sciences to psychology, seems to have 
exhausted a good deal of its potentiality 
(5). Further, as a method, it is not 
equipped to deal with purely psycho- 
logical data. As a result, and this is the 
point I have tried to make in this paper, 
psychological theory has resorted to a 
subtle, almost unconscious, translation 
of its systematic concepts in terms of 
psychological experience. This step has 
been necessary, in a sense, in order that 
psychological constructs assume some 
semblance of pertinence and meaning- 
fulness for the human _ psychological 
situation. And this experiential inter- 
polation is a necessary development in 
all psychological theory, for it is only 
in terms of this sort of interpolation that 
psychological theory can function as sig- 
nificant for the problems of applied hu- 
man psychology, and for the prediction 
and control of behavior. 

Rather than interpret this analysis 
as disjunctive and exclusive—and this 
seems to be the prevailing attitude of 
psychological theorists—it might prove 
promising to take it as conjunctive and 
inclusive. I do not mean that the ex- 
periential and objective aspects are re- 
ducible to common grounds. Nor do I 
mean that one or the other should be 
eliminated. The objective, scientific 
techniques developed by experimental 
psychology are invaluable, and any at- 
tempt at devaluating or reducing them 
would be unrealistic, to say the least. 
Experimental methods are a necessary 
means of introducing control, confirma- 
tion, and validation into theory con- 
struction. But it does not seem that 
these methods are in themselves suf- 
ficient to meet the demands of a scien- 
tific psychology. Our theories are now 
subject to experiential reinterpretation 
which takes on the color of a necessary 














adjunct to their significance and applica- 
bility. As the situation now stands, this 
experiential interpolation is unhealthy 
from the standpoint of scientific theory 
because it is extrasystematic and has no 
formal place in our theory construction. 
For this reason, the more rigorous theo- 
rists have tended to reject it explicitly, 
although they cannot avoid it implicitly 
(2). 

But, it is not entirely clear that phe- 
nomenological or experiential aspects 
need be so excluded. If these elements 
can be made explicit in our theories and 
can be justified in our methodologies, 
the present status of psychology would 
be much healthier than it is. The 
formulation of a distinctively psycho- 
logical methodology, based on the in- 
clusion of both objective and experi- 
ential methods, and giving rise to theo- 
retical construction of a distinctively 
psychological character, is a very tempt- 
ing goal. The reconstruction of such a 
distinctive and comprehensive method- 
ology must be left to the future. But 
at least a first step in its direction must 
be taken by pointing out the revelant 
elements as they function in the theories 
we have at the present time. 


SUMMARY 


Three nonconstructural elements, 
which appear in current psychological 
constructural systems, are singled out 
and briefly discussed: (a) attribution 
to a theoretical construct of “real ex- 
istence,” .as if the construct were ac- 
tually a description of the real structure 
of the organism, rather than of the or- 
ganism as it is known in the theory; 
(6) attribution of “theoretical-real ex- 
istence” to a construct, without attribut- 
ing the defined structure to the real 
organism which is merely a methodo- 
logical assumption and implies nothing 
about the real organisms; (c) phe- 
nomenological or experiential reinterpre- 
tation of theoretical constructs. Of 
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these nonconstructural aspects, the first 
is illegitimate, the second is legitimate 
and scientifically sound, and the last is 
discussed in the light of possible evolu- 
tion of a distinctively psychological 
methodology which would incorporate 
both phenomenological and behavioris- 
tic elements. 
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In this paper we shall set forth the 
elements of a theory of human problem 
solving, together with some evidence for 
its validity drawn from the currently 
accepted facts about the nature of prob- 
lem solving. What questions should a 
theory of problem solving answer? First, 
it should predict the performance of a 
problem solver handling specified tasks. 
It should explain how human problem 
solving takes place: what processes are 
used, and what mechanisms perform 
these processes. It should predict the 
incidental phenomena that accompany 
problem solving, and the relation of 
these to the problem-solving process. 
For example, it should account for “set” 
and for the apparent discontinuities that 
are sometimes called “insight.” It should 
show how changes in the attendant con- 
ditions—both changes “inside” the prob- 
lem solver and changes in the task con- 
fronting him—alter problem-solving be- 
havior. It should explain how specific 
and general problem-solving skills are 
learned, and what it is that the problem 
solver “has”? when he has learned them. 


Information Processing Systems 


Questions about problem-solving be- 
havior can be answered at various levels 
and in varying degrees of detail. The 
theory to be described here explains 
problem-solving behavior in terms of 
what we shall call information processes. 
If one considers the organism to consist 
of effectors, receptors, and a control sys- 
tem for joining these, then this theory 
is mostly a theory of the control sys- 
tem. It avoids most questions of sen- 
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sory and motor activities. 
postulates: 

1. A control system consisting of a 
number of memories, which contain 
symbolized information and are inter- 
connected by various ordering relations. 
The theory is not at all concerned with 
the physical structures that allow this 
symbolization, nor with any properties 
of the memories and symbols other than 
those it explicitly states. 

2. A number of primitive information 
processes, which operate on the informa- 
tion in the memories. Each primitive 
process is a perfectly definite operation 
for which known physical mechanisms 
exist. (The mechanisms are not neces- 
sarily known to exist in the human 
brain, however—we are only concerned 
that the processes be described without 
ambiguity.) 

3. A perfectly definite set of rules for 
combining these processes into whole 
programs of processing. From a pro- 
gram it is possible to deduce unequivo- 
cally what externally observable behav- 
iors will be generated. 

At this level of theorizing, an ex- 
planation of an observed behavior of 
the organism is provided by a program 
of primitive information processes that 
generates this behavior. 

A program viewed as a theory of 
behavior is highly specific: it describes 
one organism in a particular class of 
situations. When either the situation 
or the organism is changed, the pro- 
gram must be modified. The program 
can be used as a theory—that is, as a 
predictor of behavior—in two distinct 


The theory 
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ways. First, it makes many precise 
predictions that can be tested in detail 
regarding the area of behavior it is 
designed to handle. For example, the 
theory considered in this paper predicts 
exactly how much difficulty an organ- 
ism with the specified program will en- 
counter in solving each of a series of 
mathematical problems: which of the 
problems it will solve, how much time 
(up to a proportionality constant) will 
be spent on each, and so on. 

Second, there will be important quali- 
tative similarities among the programs 
that an organism uses in various situa- 
tions, and among the programs used by 
different organisms in a given situation. 
The program that a human subject uses 
to solve mathematical problems will be 
similar in many respects to the program 
he uses to choose a move in chess; the 
program one subject uses for any such 
task will resemble the programs used by 
other subjects possessing similar train- 
ing and abilities. If there were no such 
similarities, if each subject and each 
task were completely idiosyncratic, there 
could be no theory of human problem 
solving. Moreover, there is some posi- 
tive evidence, as we shall see, that such 
similarities and general characteristics 
of problem-solving processes do exist. 

In this paper we shall limit ourselves 
to this second kind of validation of our 
theory of problem solving. We shall 
predict qualitative characteristics of hu- 
man problem-solving behavior and com- 
pare them with those that have already 
been observed and described. Since all 
of the available data on the psychology 
of human problem solving are of this 
qualitative kind, no more detailed test 
of a program is possible at present. The 
more precise validation must wait upon 
new experimental work.* 


1Several studies of individual and group 
problem-solving behavior with logic problems 
have been carried out by O. K. Moore and 
Scarvia Anderson (5). The problems Moore 
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In succeeding sections we shall de- 
scribe an information-processing pro- 
gram for discovering proofs for theo- 
rems in logic. We shall compare its be- 
havior qualitatively with that of human 
problem solvers. In general, the proc- 
esses that compose the program are 
familiar from everyday experience and 
from research on human problem solv- 
ing: searching for possible solutions, 
generating these possibilities out of 
other elements, and evaluating partial 
solutions and cues. From this stand- 
point there is nothing particularly novel 
about the theory. It rests its claims on 
other considerations: 

1. It shows specifically and in detail 
how the processes that occur in human 
problem solving can be compounded out 
of elementary information processes, and 
hence how they can be carried out by 
mechanisms. 

2. It shows that a program incorpo- 
rating such processes, with appropriate 
organization, can in fact solve problems. 
This aspect of problem solving has been 
thought to be “mysterious” and unex- 
plained because it was not understood 
how sequences of simple processes could 
account for the successful solution of 
complex problems. The theory dissolves 
the mystery by showing that nothing 
more need be added to the constitution 
of a successful problem solver. 


Relation to Digital Computers 


The ability to specify programs pre- 
cisely, and to infer accurately the be- 
havior they will produce, derives from 
the use of high-speed digital computers. 
Each specific theory—each program of 


and Anderson gave their subjects are some- 
what different from those handled by our 
program, and hence a detailed comparison of 
behavior is not yet possible. We are now en- 
gaged, with Peter Houts, in replicating and 
extending the experiments of Moore and An- 
derson with human subjects and at the same 
time modifying our program to predict the 
human laboratory behavior in detail. 
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information processes that purports to 
describe some human behavior—is coded 
for a computer. That is, each primitive 
information process is coded to be a 
separate computer routine, and a “mas- 
ter” routine is written that allows these 
primitive processes to be assembled into 
any system we wish to specify. Once 
this has been done, we can find out 
exactly what behavior the purported 
theory predicts by having the computer 
“simulate” the system. 

We wish to emphasize that we are not 
using the computer as a crude analogy 
to human behavior—we are not com- 
paring computer structures with brains, 
nor electrical relays with synapses. Our 
position is that the appropriate way to 
describe a piece of problem-solving be- 
havior is in terms of a program: a 
specification of what the organism will 
do under varying environmental circum- 
stances in terms of certain elementary 
information processes it is capable of 
performing. This assertion has nothing 
to do—directly—with computers. Such 
programs could be written (now that 
we have discovered how to do it) if 
computers had never existed. A pro- 
gram is no more, and no less, an analogy 
to the behavior of an organism than is 
a differential equation to the behavior 
of the electrical circuit it describes. 
Digital computers come into the picture 


2 We can, in fact, find a number of attempts 
in the psychological literature to explain be- 
havior in terms of programs—or the proto- 
types thereof. One of the most interesting, 
because it comes relatively close to the mod- 
ern conception of a computer program, is 
Adrian de Groot’s analysis of problem solving 
by chess players (2). The theory of de Groot 
is based on the thought-psychology of Selz, a 
somewhat neglected successor to the Wurzburg 
school. Quite recently, and apparently inde- 
pendently, we find the same idea applied by 
Jerome S. Bruner and his associates to the 
theory of concept formation (1). Bruner uses 
the term “strategy,” derived from economics 
and game theory, for what we have called a 
program. 
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only because they can, by appropriate 
programming, be induced to execute the 
same sequences of information processes 
that humans execute when they are 
solving problems. Hence, as we shall 
see, these programs describe both hu- 
man and machine problem solving at 
the level of information processes.® 
With this discussion of the relation of 
programs to machines and humans be- 
hind us, we can afford to relax into con- 
venient, and even metaphoric, uses of 
language without much danger of mis- 
understanding. It is often convenient 
to talk about the behavior implied by a 
program as that of an existing physical 
mechanism doing things. This mode of 
expression is legitimate, for if we take 
the trouble to put any particular pro- 
gram in a computer, we have in fact a 
machine that behaves in the way pre- 
scribed by the program. Similarly, for 
concreteness, we will often talk as if 
our theory of problem solving consisted 
of statements about the ability of a 
computer to do certain things. 


Tue Locic THEORIST 


We can now turn to an example of 


the theory. This is a program capable 
of solving problems in a particular do- 
main—capable, specifically, of discover- 
ing proofs for theorems in elementary 
symbolic logic. We shall call this pro- 
gram the Logic Theorist (LT).* We 
assert that the behavior of this pro- 
gram, when the stimulus consists of the 
instruction that it prove a particular 
theorem, can be used to predict the be- 


8’ For a fuller discussion of this point see 
(9). 

*In fact, matters are a little more compli- 
cated, for in the body of this paper we will 
consider both the basic program of LT and a 
number of variants on this program. We will 
refer to all of these variants, interchangeably, 
as “LT.” This will not be confusing, since 
the exact content of the program we are con- 
sidering at any particular point will always 
be clear from the context. 
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havior of (certain) humans when they 
are faced with the same problem in 
symbolic logic. 

The program of LT was not fash- 
ioned directly as a theory of human be- 
havior; it was constructed in order to 
get a program that would prove theo- 
rems in logic. To be sure, in construct- 
ing it the authors were guided by a firm 
belief that a practicable program could 
be constructed only if it used many of 
the processes that humans use. The 
fact remains that the program was not 
devised by fitting it directly to human 
data. As a result, there are many de- 
tails of LT that we would not expect to 
correspond to human behavior. For ex- 
ample, no particular care was exercised 
in choosing the primitive information 
processes to correspond, point by point, 
with elementary human processes. All 
that was required in writing the pro- 
gram was that the primitive processes 
constitute a sufficient set and a con- 
venient set for the type of program 
under study. 

Since LT has been described in de- 
tail elsewhere (6, 8), the description 
will not be repeated here. It will also 
be unnecessary to describe in detail the 
system of symbolic logic that is used by 
LT. For those readers who are not fa- 
miliar with symbolic logic, we may re- 
mark that problems in the sentential 
calculus are at about the same level of 
difficulty and have somewhat the same 
“flavor” as problems in high school ge- 
ometry.® 


Design of the Experiments 


First we will describe the overt be- 
havior of LT when it is presented with 
problems in elementary symbolic logic. 


5 LT employs the sentential calculus as set 
forth in Chapters 1 and 2 of A. N. Whitehead 
and Bertrand Russell, Principia Mathematica 
(10)—tthe “classic” of modern symbolic logic. 
A simple introduction to the system of Prin- 
cipia will be found in (3). 
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In order to be concrete, we will refer to 
an experiment conducted on a digital 
computer. We take an ordinary gen- 
eral-purpose digital computer,* and store 
in its memory a program for interpret- 
ing the specifications of LT. Then we 
load the program that specifies LT. 
The reader may think of this program 
as a collection of techniques that LT 
has’ acquired for discovering proofs. 
These techniques range from the abil- 
ity to read and write expressions in 
symbolic logic to general schemes for 
how a proof might be found. 

Once we have loaded this program 
and pushed the start button, the com- 
puter, to all intents and purposes, is 
LT. It already knows how to do sym- 
bolic logic, in the sense that the basic 
rules of operation of the mathematics 
are already in the program (analogously 
to a human’s knowing that “equals 
added to equals give equals” in ele- 
mentary algebra). 

We are now ready to give LT a task. 
We give it a list of the expressions 
(axioms and previously proved theo- 
rems) that it may take as “given” for 
the task at hand. These are stored in 
LT’s memory. Finally, we present LT 
with another expression and instruct it 
to discover a proof for this expression. 

From this point, the computer is on 
its own. The program plus the task 
uniquely determines its behavior. It at- 
tempts to find a proof—that is, it tries 
various techniques, and if they don’t 


6 The experiments described here were car- 
ried out with the RAND JOHNNIAC com- 
puter. The JOHNNIAC is an automatic dig- 
ital computer of the Princeton type. It has a 
word length of 40 bits, with two instructions 
in each word. Its fast storage consists of 
4,096 words of magnetic cores, and its second- 
ary storage consists of 9,216 words on mag- 
netic drums. Its speed is about 15,000 op- 
erations per second. The programming tech- 
niques used are described more fully in (6). 
The experiments are reported in more detail 
in (7). 














work, it tries other techniques. If LT 
finds a legitimate proof, it prints this 
out on a long strip of paper. There is, 
of course, no guarantee that it will find 
a proof; after working for some time, 
the machine will give up—that is, it will 
stop looking for a proof. 

Now the experimenters know exactly 
what is in the memory of LT when it 
starts—indeed, they created the pro- 
gram. This, however, is quite differ- 
ent from saying that the experimenters 
can predict everything LT will do. In 
principle this is possible; but in fact 
the program is so complex that the only 
way to make detailed predictions is to 
employ a human to simulate the pro- 
gram by hand. (A human can do any- 
thing a digital computer can do, al- 
though it may take him considerably 
longer.) 

1. As the initial experiment, we stored 
the axioms of Principia Mathematica, 
together with the program, in the mem- 
ory of LT, and then presented to LT 
the first 52 theorems in Chapter 2 of 
Principia in the sequence in which they 
appear there. LT’s program specified 
that as a theorem was proved it was 
stored in memory and was available, 
along with the axioms, as material for 
the construction of proofs of subsequént 
theorems. With this program and this 
order of presentation of problems, LT 
succeeded in proving 38 (73°) of the 
52 theorems. About half of the proofs 
were accomplished in less than a minute 
each; most of the remainder took from 
one to five minutes. A few theorems 
were proved in times ranging from 15 
minutes to 45 minutes. There was a 
strong relation between the times and 
the lengths of the proofs—the time in- 
creasing sharply (perhaps exponentially ) 
with each additional proof step. 

2. The initial conditions were now re- 
stored by removing from LT’s memory 
the theorems it had proved. (Trans- 
late: “A new subject was obtained who 
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knew how to solve problems in logic but 
was unfamiliar with the particular prob- 
lems to be used in the experiment.’’) 
When one of the later theorems of 
Chapter 2 (Theorem 2.12) was pre- 
sented to LT, it was not able to find 
a proof, although when it had held the 
prior theorems in memory, it had found 
one in about ten seconds. 

3. Next, an experiment was performed 
intermediate between the first two. The 
axioms and Theorem 2.03 were stored in 
memory, but not the other theorems 
prior to Theorem 2.12, and LT was 
again given the task of proving the lat- 
ter. Now, using Theorem 2.03 as one 
of its resources, LT succeeded—in fif- 
teen minutes—where it had failed in the 
second experiment. The proof required 
three steps. In the first experiment, 
with all prior theorems available, the 
proof required only one step. 





Outcome of the Experiments 


From these three series of experiments 
we obtain several important pieces of 
evidence that the program of LT is 
qualitatively like that of a human faced 
with the same task. The first, and 
most important, evidence is that LT 
does in fact succeed in finding proofs 
for a large number of theorems. 

Let us make this point quite clear. 
Since LT can actually discover proofs 
for theorems, its program incorporates a 
sufficient set of elementary processes ar- 
ranged in a sufficiently effective strategy 
to produce this result. Since no other 
program has ever been specified for 
handling successfully these kinds of 
problem-solving tasks, no definite al- 
ternative hypothesis is available. We 
are well aware of the standard argu- 
ment that “similarity of function does 
not imply similarity of process.” How- 
ever useful a caution this may be, it 
should not blind us to the fact that 
specification of a set of mechanisms 
sufficient to produce observed behavior 
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is strong confirmatory evidence for the 
theory embodying these mechanisms, es- 
pecially when it is contrasted with theo- 
ries that cannot establish their suffi- 
ciency. 

The only alternative problem-solving 
mechanisms that have been completely 
specified for these kinds of tasks are 
simple algorithms that carry out ex- 
haustive searches of all possibilities, 
substituting “brute force” for the selec- 
tive search of LT. Even with the speeds 
available to digital computers, the prin- 
cipal algorithm we have devised as an 
alternative to LT would require times 
of the order of hundreds or even thou- 
sands of years to prove theorems that 
LT proves in a few minutes. LT’s suc- 
cess does not depend on the “brute 
force” use of a computer’s speed, but 
on the use of heuristic processes like 
those employed by humans.” This can 
be seen directly from examination of the 
program, but it also shows up repeat- 
edly in all the other behavior exhibited 
by LT. 

The second important fact that 
emerges from the experiments is that 
LT’s success depends in a very sensitive 
way upon the order in which problems 
are presented to it. When the sequence 
is arranged so that before any particu- 
lar problem is reached some potentially 
helpful intermediate results have al- 
ready been obtained, then the task is 
easy. It can be made progressively 
harder by skipping more and more 
of these intermediate stepping-stones. 
Moreover, by providing a single “hint,” 
as in the third experiment (that is, 
“Here is a theorem that might help”), 
we can induce LT to solve a problem 
it had previously found insoluble. All 
of these results are easily reproduced in 
the laboratory with humans. To com- 
pare LT’s behavior with that of a hu- 


7 A quantitative analysis of the power of the 
heuristics incorporated in LT will be found in 
(7). 
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man subject, we would first have to 
train the latter in symbolic logic (this 
is equivalent to reading the program 
into LT), but without using the specific 
theorems of Chapter 2 of Principia 
Mathematica that are to serve as prob- 
lem material. We would then present 
problems to the human subject in the 
same sequence as to LT. For each new 
sequence we would need naive subjects, 
since it is difficult to induce a human 
subject to forget completely theorems 
he has once learned. 


PERFORMANCE PROCESSES IN THE 
Locic THEORIST 


We can learn more about LT’s ap- 
proximation to human problem solving 
by instructing it to print out some of 
its intermediate results—to work its 
problems on paper, so to speak. The 
data thus obtained can be compared 
with data obtained from a human sub- 
ject who is asked to use scratch paper 
as he works a problem, or to think 
aloud.* Specifically, the computer can 
be instructed to print out a record of 
the subproblems it works on and the 
methods it applies, successfully and un- 
successfully, while seeking a solution. 
We can obtain this information at any 
level of detail we wish, and make a 
correspondingly detailed study of LT’s 
processes. 

To understand the additional informa- 
tion provided by this “thinking aloud” 
procedure, we need to describe a little 


8 Evidence obtained from a subject who 
thinks aloud is sometimes compared with evi- 
dence obtained by asking the subject to theo- 
rize introspectively about his own thought 
processes. This is misleading. Thinking aloud 
is just as truly behavior as is circling the cor- 
rect answer on a paper-and-pencil test. What 
we infer from it about other processes going 
on inside the subject (or the machine) is, of 
course, another question. In the case of the 
machine, the problem is simpler than in the 
case of the human, for we can determine ex- 
actly the correspondence between the internal 
processes and what the machine prints out. 
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more fully how LT goes about solving 
problems. This description has two 
parts: (a) specifying what constitutes 
a proof in symbolic logic; () describ- 
ing the methods that LT uses in find- 
ing proofs. 


Nature of a Proof 


A proof in symbolic logic (and in 
other branches of logic and mathemat- 
ics) is a sequence of statements such 
that each statement: (a) follows from 
one or more of the others that precede 
it in the sequence, or (4) is an axiom or 
previously proved theorem.® Here “fol- 
lows” means “follows by the rules of 
logic.” 

LT is given four rules of inference: 

Substitution. In a true expression 
(for example, “[p or p] implies p”) 
there may be substituted for any vari- 
able a new variable or expression, pro- 
vided that the substitution is made 
throughout the original expression. 
Thus, by substituting p or q for p in 
the expression “(p or p) implies p,” we 
get: “({p or q] or [p or q]) implies 
(p or q)” but not: “([p or q] or p) 
implies p.” 


® The axioms of symbolic logic and the theo- 
ries that follow from them are all tautologies, 
true by virtue of the definitions of their terms. 
It is their tautological character that gives 
laws of logic their validity, independent of 
empirical evidence, as rules of inductive in- 
ference. Hence the very simple axioms that 
we shall use as examples here will have an 
appearance of redundancy, if not triviality. 
For example, the first axiom of Principia 
states, in effect, that “if any particular sen- 
tence (call it p) is true, or if that same sen- 
tence (p) is true, then that sentence (p) is, 
indeed, true’—for example, “if frogs are fish, 
or if frogs are fish, then frogs are fish.” The 
“if---then” is trivially and tautologically true 
irrespective of whether p is true, for in truth 
frogs are not fish. Since our interest here is 
in problem solving, not in logic, the reader 
can regard LT’s task as one of manipulating 
symbols to produce desired expressions, and 
he can ignore the material interpretations of 
these symbols. 
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Replacement. In a true expression a 
connective (“implies,” etc.) may be re- 
placed by its definition in terms of other 
connectives. Thus “A implies B” is de- 
fined to be “not-A or B”; hence the two 
forms can be used interchangeably. 

Detachment. If “A” is a true expres- 
sion and “A implies B” is a true expres- 
sion, then B may be written down as a 
true expression. 

Syllogism (Chaining). It is possible 
to show by two successive applications 
of detachment that the following is also 
legitimate: If “a implies b” is a true 
expression and “b implies c” is a true 
expression, then “a implies c” is also a 
true expression. 


Proof Methods 


The task of LT is to construct a 
proof sequence deriving a problem ex- 
pression from the axioms and the previ- 
ously proved theorems by the rules of 
inference listed above. But the rules 
of inference, like the rules of any mathe- 
matical system or any game, are per- 
missive, not mandatory. That is, they 
state what sequences may legitimately 
be constructed, not what particular se- 
quence should be constructed in order 
to achieve a particular result (i.e., to 
prove a particular problem expression). 
The set of “legal” sequences is exceed- 
ing large, and to try to find a suitable 
sequence by trial and error alone would 
almost always use up the available time 
or memory before it would exhaust the 
set of legal sequences.*° 

To discover proofs, LT uses methods 
which are particular combinations of in- 
formation processes that result in co- 
ordinated activity aimed at progress in 
a particular direction. LT has four 
methods (it could have more): subdsti- 


10See (7). The situation here is like that 
in chess or checkers where the player knows 
what moves are legal but has to find in a rea- 
sonable time a move that is also “suitable”’— 
that is, conducive to winning the game. 
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tution, detachment, forward chaining, 
and backward chaining. Each method 
focuses on a single possibility for achiev- 
ing a link in a proof. 

The substitution method attempts to 
prove an expression by generating it 
from a known theorem employing sub- 
stitutions of variables and replacements 
of connectives. 

The detachment method tries to work 
backward, utilizing the rule of detach- 
ment to obtain a new expression whose 
proof implies the proof of the desired 
expression. This possibility arises from 
the fact that if B is to be proved, and 
we already know a theorem of the form 
“A implies B,” then proof of A is tan- 
tamount to proof of B. 

Both chaining methods try to work 
backward to new problems, using the 
rule of syllogism, analogously to the 
detachment method. Forward chaining 
uses the fact that if “a implies c” is 
desired and “a implies b” is already 
known, then it is sufficient to prove “b 
implies c.” Backward chaining runs the 
argument the other way: desiring “a 
implies c’” and knowing “b implies c” 
yields “a implies b” as a new problem. 

The methods are the major organiza- 
tions of processes in LT, but they are 
not all of it. There is an executive 
process that coordinates the use of the 
methods, and selects the subproblems 
and theorems upon which the methods 
operate. The executive process also ap- 
plies any learning processes that are to 
be applied. Also, all the methods uti- 
lize common subprocesses in carrying 
out their activity. The two most im- 
portant subprocesses are the matching 
process, which endeavors to make two 
given subexpressions identical, and the 
similarity test, which determines (on 
the basis of certain computed descrip- 
tions) whether two expressions are 
“similar” in a certain sense (for de- 
tails, cf. 8). 

LT can be instructed to list its at- 
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attempts, successful and unsuccessful, to 
use these methods, and can list the new 
subproblems generated at each stage by 
these attempts. We can make this con- 
crete by an example: 

Suppose that the problem is to prove 
“p implies p.” The statement “(p or 
p) implies p” is an axiom; and “p im- 
plies (p or p)” is a theorem that has 
already been proved and stored in the 
theorem memory. Following its pro- 
gram, LT first tries to prove “p im- 
plies p” by the substitution method, but 
fails because it can find no similar theo- 
rem in which to make substitutions. 

Next, it tries the detachment method. 
Letting B stand for “p implies p,” sev- 
eral theorems are found of the form “A 
implies B.” For example, by substitu- 
tion of not-p for q, “p implies (q or p)” 
becomes “p implies (not-p or p)”; this 
becomes, in turn, by replacement of 
“or” by “implies”: “p implies (p im- 
plies p).” Discovery of this theorem 
creates a new subproblem: “Prove A” 
—that is, “prove p.”’ This subproblem, 
of course, leads nowhere, since p is not 
a universally true theorem, hence can- 
not be proved. 

At a later stage in its search LT tries 
the chaining method. Chaining for- 
ward, it finds the theorem “p implies (p 
or p)” and is then faced with the new 
problem of proving that “(p or p) im- 
plies p.” This it is able to do by the 
substitution method, when it discovers 
the corresponding axiom. 

All of these steps, successful and un- 
successful, in its proof—and the ones 
we have omitted from our exposition, as 
well—can be printed out to provide us 
with a complete record of how LT exe- 
cuted its program in solving this par- 
ticular problem. 


SoME CHARACTERISTICS OF THE 
PROBLEM-SOLVING PROCESS 


Using as our data the information 
provided by LT as to the methods it 
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tries, the sequence of these methods, 
and the theorems employed, we can ask 
whether its procedure shows any re- 
semblance to the human problem-solv- 
ing process as it has been described in 
psychological literature. We find that 
there are, indeed, many such resem- 
blances, which we summarize under the 
following headings: set, insight, con- 
cept formation, and structure of the 
problem-subproblem hierachy. 


Set 


The term “set,” sometimes defined as 
“a readiness to make a specified re- 
sponse to a specified stimulus” (4, p. 
65), covers a variety of psychological 
phenomena. We should not be sur- 
prised to find that more than one as- 
pect of LT’s behavior exhibits “set,” 
nor that these several evidences of set 
correspond to quite different underlying 
processes. 

1. Suppose that after the program 
has been loaded in LT, the axioms and 
a sequence of problem expressions are 
placed in its memory. Before LT un- 
dertakes to prove the first problem ex- 
pression, it goes through the list of 
axioms and computes a description of 
each for subsequent use in the “simi- 
larity” tests. For this reason, the proof 
of the first theorem takes an extra in- 
terval of time amounting, in fact, to 
about twenty seconds. Functionally 
and phenomenologically, this computa- 
tion process and interval represent a 
preparatory set in the sense in which 
that term is used in reaction-time ex- 
periments. It turns out in LT that this 
preparatory set saves about one third 
of the computing time that would other- 
wise be required in later stages of the 
program. 

2. Directional set is also evident in 
LT’s behavior. When it is attempting 


a particular subproblem, LT tries first 
to solve it by the substitution method. 
If this. proves fruitless, and only then, 
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it tries the detachment method, then 
chaining forward, then chaining back- 
ward. Now when it searches for 
theorems suitable for the substitution 
method, it will not notice theorems that 
might later be suitable for detachment 
(different similarity tests being applied 
in the two cases). It attends single- 
mindedly to possible candidates for sub- 
stitution until the theorem list has been 
exhausted; then it turns to the detach- 
ment method. 

3. Hints and the change in behavior 
they induce have been mentioned ear- 
lier. Variants of LT exist in which the 
order of methods attempted by LT, and 
the choice of units in describing expres- 
sions, depend upon appropriate hints 
from the experimenter. 

4. Effects from directional set occur 
in certain learning situations—as illus- 
trated, for example, by the classical ex- 
periments of Luchins. Although LT at 
the present time has only a few learn- 
ing mechanisms, these will produce’ 
strong effects of directional set if prob- 
lems are presented to LT in appropriate 
sequences. For example, it required 
about 45 minutes to prove Theorem 
2.48 in the first experiment because 
LT, provided with all the prior theo- 
rems, explored so many blind alleys. 
Given only the axioms and Theorem 
2.16, LT proved Theorem 2.48 in about 
15 minutes because it now considered a 
quite different set of possibilities. 

The instances of set observable in the 
present program of LT are natural and 
unintended by-products of a program 
constructed to solve problems in an effi- 
cient way. In fact, it is difficult to see 
how we could have avoided such effects. 
In its simplest aspect, the problem-solv- 
ing process is a search for a solution in 
a very large space of possible solutions. 
The possible solutions must be examined 
in some particular sequence, and if they 
are, then certain possible solutions will 
be examined before others. The par- 
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ticular rule that induces the order of 
search induces thereby a definite set in 
the ordinary psychological meaning of 
that term. 

Preparatory set also arises from the 
need for processing efficiency. If cer- 
tain information is needed each time a 
possible solution or group of solutions 
is to be examined, it may be useful to 
compute this information, once and for 
all, at the beginning of the problem- 
solving process, and to store it instead 
of recomputing it each time. 

The examples cited show that set can 
arise in almost every aspect of the 
problem-solving process. It can govern 
the sequence in which alternatives are 
examined (the “method” set), it can se- 
lect the concepts that are used in classi- 
fying perceptions (the “viewing” set), 
and it can consist in preparatory proc- 
esses (the description of axioms). 

None of the examples of set in LT re- 
late to the way in which information is 
stored in memory. However, one would 
certainly expect such set to exist, and 
certain psychological phenomena bear 
this out—the set in association experi- 
ments, and so-called “incubation” proc- 
esses. LT as it now stands is inade- 
quate in this respect. 


Insight 


In the psychological literature, “in- 
sight” has two principal connotations: 
(a) “suddenness” of discovery, and (6) 
grasp of the “structure” of the problem, 
as evidenced by absence of trial and 
error. It has often been pointed out 
that there is no necessary connection 
between the absence of overt trial-and- 
error behavior and grasp of the prob- 
lem structure, for trial and er.or may 
be perceptual or ideational, and no ob- 
vious cues may be present in behavior 
to show that it is going on. 

In LT an observer’s assessment of 
how much trial and error there is will 
depend on how much of the record of 


ALLEN NewELL, J. C. SHAW, AND HERBERT A. SIMON 


its problem-solving processes the com- 
puter prints out. Moreover, the amount 
of trial and error going on “inside” 
varies within very wide limits, depend- 
ing on small changes in the program. 

The performance of LT throws some 
light on the classical debate between 
proponents of trial-and-error learning 
and proponents of “insight,” and shows 
that this controversy, as it is usually 
phrased, rests on ambiguity and con- 
fusion. LT searches for solutions to 
the problems that are presented it. 
This search must be carried out in some 
sequence, and LT’s success in actually 
finding solutions for rather difficult 
problems rests on the fact that the se- 
quences it uses are not chosen casually 
but do, in fact, depend on problem 
“structure.” 

To keep matters simple, let us con- 
sider just one of the methods LT uses 
—proof by substitution. The number 
of valid proofs (of some theorem) that 
the machine can construct by substitu- 
tion of new expressions for the variables 
in the axioms is limited only by its pa- 
tience in generating expressions. Sup- 
pose now that LT is presented with a 
problem expression to be proved by sub- 
stitution. The crudest trial-and-error 
procedure we can imagine is for the 
machine to generate substitutions in a 
predetermined sequence that is inde- 
pendent of the expression to be proved, 
and to compare each of the resulting 
expressions with the problem expres- 
sion, stopping when a pair are identical 
(cf. 7). 

Suppose, now, that the generator of 
substitutions is constructed so that it is 
not independent of the problem expres- 
sion—so that it tries substitutions in 
different sequences depending on the 
nature of the latter. Then, if the de- 
pendence is an appropriate one, the 
amount of search required on the aver- 
age can be reduced. A simple strategy 
of this sort would be to try in the 
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axioms only substitutions involving vari- 
ables that actually appear in the prob- 
lem expression. 

The actual generator employed by LT 
is more efficient (and hence more “in- 
sightful” by the usual criteria) than 
this. In fact, it works backward from 
the problem expression, and takes into 
account necessary conditions that a sub- 
stitution must satisfy if it is to work. 
For example, suppose we are substitut- 
ing in the axiom “p implies (q or p),” 
and are seeking to prove “r implies (r 
or r).” Working backward, it is clear 
that if the latter expression can be ob- 
tained from the former by substitution 
at all, then the variable that must be 
substituted for p is r. This can be seen 
by examining the first variable in each 
expression, without considering the rest 
of the expression at all (cf. 7). 

Trial and error is reduced to still 
smaller proportions by the method for 
searching the list of theorems. Only 
those theorems are extracted from the 
list for attempted substitution which 
are “similar” in a defined sense to the 
problem expression. This means, in 
practice, that substitution is attempted 
in only about ten per cent of the theo- 
rems. Thus a trial-and-error search of 
the theorem list to find theorems simi- 
lar to the problem expression is. substi- 
tuted for a trial-and-error series of at- 
tempted substitutions in each of the 
theorems. 

In these examples, the concept of 
proceeding in a “meaningful” fashion 
is entirely clear and explicit. Trial- 
and-error attempts take place in some 
“space” of possible solutions. To ap- 
proach a problem “meaningfully” is to 
have a strategy that either permits the 
search to be limited to a smaller sub- 
space, or generates elements of the space 
in an order that makes probable the 
discovery of one of the solutions early 
in the process. 
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We have already listed some of the 
most important elements in the pro- 
gram of LT for reducing search to 
tolerable proportions. These are: (a) 
the description programs to select theo- 
rems that are “likely” candidates for 
substitution attempts; (5) the process 
of working backwards, which uses in- 
formation about the goal to rule out 
large numbers of attempts without 
actually trying them. In addition to 


these, the executive routine may select 
the sequence of subproblems to be 
worked on in an order that takes up 
“simple” subproblems first. 


Concepts 


Most of the psychological research on 
concepts has focused on the processes 
of their formation. The current ver- 
sion of LT is mainly a performance pro- 
gram, and hence shows no concept for- 
mation. There is in the program, how- 
ever, a clearcut example of the use of 
concepts in problem solving. This is 
the routine for describing theorems and 
searching for theorems “similar” to the 
problem expression or some part of it 
in order to attempt substitutions, de- 
tachments, or chainings. All theorems 
having the same description exemplify 
a common concept. We have, for ex- 
ample, the concept of an expression 
that has a single variable, one argument 
place on its left side, and two argument 
places on its right side: “p implies (p 
or p)” is an expression exemplifying 
this concept; so is “q implies (q im- 
plies q).” 

The basis for these concepts is purely 
pragmatic. Two expressions having the 
same description “look alike” in some 
undefined sense; hence, if we are seek- 
ing to prove one of them as a theorem, 
while the other is an axiom or theorem 
already proved, the latter is likely con- 
struction material for the proof of the 
former. 
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Hierarchies of Processes 


Another characteristic of the behav- 
ior of LT that resembles human prob- 
lem-solving behavior is the hierarchical 
structure of its processes. Two kinds 
of hierarchies exist, and these will be 
described in the next two paragraphs. 

In solving a problem, LT breaks it 
down into component problems. First 
of all, it makes three successive at- 
tempts: a proof by substitution, a proof 
by detachment, or a proof by chaining. 
In attempting to prove a theorem by 
any of these methods, it divides its task 
into two parts: first, finding likely raw 
materials in the form of axioms or theo- 
rems previously proved; second, using 
these materials in matching. To find 
theorems similar to the problem expres- 
sion, the first step is to compute a de- 
scription of the problem expression; the 
second step is to search the list of theo- 
rems for expressions with the same de- 
scription. The description-computing 
program divides, in turn, into a pro- 
gram for computing the number of lev- 
els in the expression, a program for 
computing the number of distinct vari- 
ables, and a program for computing the 
number of argument places. 

LT has a second kind of hierarchy 
in the generation of new expressions to 
be proved. Both the detachment and 
chaining methods do not give proofs di- 
rectly but, instead, provide new alter- 
native expressions to prove. LT keeps 
a list of these subproblems, and, since 
they are of the same type as the origi- 
nal problem, it can apply all its prob- 
lem-solving methods to them. These 
methods, of course, yield yet other sub- 
problems, and in this way a large net- 
work of problems is developed during 
the course of proving a given logic ex- 
pression. The importance of this type 
of hierarchy is that it is not fixed 
in advance, but grows in response to 
the problem-solving process itself, and 
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shows some of the flexibility and trans- 
ferability that seem to characterize hu- 
man higher mental processes. 

The problem-subproblem hierarchy in 
LT’s program is quite comparable with 
the hierarchies that have been discov- 
ered by students of human problem- 
solving processes, and particularly by 
de Groot in his detailed studies of the 
thought methods of chess players (2, 
pp. 78-83, 105-111). Our earlier dis- 
cussion of insight shows how the pro- 
gram structure permits an efficient com- 
bination of trial-and-error search with 
systematic use of experience and cues 
in the total problem-solving process. 


SUMMARY OF THE EVIDENCE 


We have now reviewed the principal 
evidence that LT solves problems in a 
manner Closely resembling that exhibited 
by humans in dealing with the same 
problems. First, and perhaps most im- 
portant, it is in fact capable of finding 


proofs for theorems—hence incorporates 
a system of processes that is sufficient 


for a problem-solving mechanism. Sec- 
ond, its ability to solve a particular 
problem depends on the sequence in 
which problems are presented to it in 
much the same way that a human sub- 
ject’s behavior depends on this sequence. 
Third, its behavior exhibits both pre- 
paratory and directional set. Fourth, 
it exhibits insight both in the sense of 
vicarious trial and error leading to “sud- 
den” problem solution, and in the sense 
of employing heuristics to keep the to- 
tal amount of trial and error within rea- 
sonable bounds. Fifth, it employs sim- 
ple concepts to classify the expressions 
with which it deals. Sixth, its program 
exhibits a complex organized hierarchy 
of problems and subproblems. 


COMPARISON WITH OTHER THEORIES 

We have proposed a theory of the 
higher mental processes, and have shown 
how LT, which is a particular exemplar 
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of the theory, provides an explanation 
for the processes used by humans to 
solve problems in symbolic logic. What 
is the relation of this explanation to 
others that have been advanced? 


Associationism 


The broad class of theories usually 
labelled “associationist” share a gener- 
ally behaviorist viewpoint and a com- 
mitment to reducing mental functions 
to elementary, mechanistic neural events. 
We agree with the associationists that 
the higher mental processes can be per- 
formed by mechanisms—indeed, we have 
exhibited a specific set of mechanisms 
capable of performing some of them. 

We have avoided, however, specify- 
ing these mechanisms in neurological 
or pseudo-neurological terms. Problem 


solving—at the information-processing 
level at which we have described it— 
has nothing specifically “neural” about 
it, but can be performed by a wide class 


of mechanisms, including both human 
brains and digital computers. We:do 
not believe that this functional equiva- 
lence between brains and computers im- 
plies any structural equivalence at a 
more minute anatomical level (e.g., 
equivalence of neurons with circuits). 
Discovering what neural mechanisms re- 
alize these information-processing func- 
tions in the human brain is a task for 
another level of theory ‘construction. 
Our theory is a theory of the informa- 
tion processes involved in problem solv- 
ing, and not a theory of neural or elec- 
tronic mechanisms for information proc- 
essing. 

The picture of the central nervous 
system to which our theory leads is a 
picture of a more complex and active 
system than that contemplated by most 
associationists. The notions of “trace,” 
“fixation,” “excitation,” and “inhibi- 
tion” suggest a relatively passive elec- 
trochemical system (or, alternatively, a 
passive “switchboard”), acted upon by 
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stimuli, altered by that action, and sub- 
sequently behaving in a modified man- 
ner when later stimuli impinge on it. 

In contrast, we postulate an informa- 
tion-processing system -with large stor- 
age capacity that holds, among other 
things, complex strategies (programs) 
that may be evoked by stimuli. The 
stimulus determines what strategy or 
strategies will be evoked; the content 
of these strategies is already largely de- 
termined by the previous experience of 
the system. The ability of the system 
to respond in complex and highly se- 
lective ways to relatively simple stimuli 
is a consequence of this storage of pro- 
grams and this “active” response to 
stimuli. The phenomena of set and in- 
sight that we have already described 
and the hierarchical structure of the re- 
sponse system are all consequences of 
this “active” organization of the cen- 
tral processes. 

The historical preference of behavior- 
ists for a theory of the brain that pic- 
tured it as a passive photographic plate 
or switchboard, rather than as an ac- 
tive computer, is no doubt connected 
with the struggle against vitalism. The 
invention of the digital computer has 
acquainted the world with a device— 
obviously a mechanism—whose response 
to stimuli is clearly more complex and 
“active” than the response of more tra- 
ditional switching networks. It has pro- 
vided us with operational and unobjec- 
tionable interpretations of terms like 
“purpose,” “set,” and “insight.” The 
real importance of the digital computer 
for the theory of higher mental proc- 
esses lies not merely in allowing us to 
realize such processes “in the metal” 
and outside the brain, but in providing 
us with a much profounder idea than 
we have hitherto had of the character- 
istics a mechanism must possess if it is 
to carry out complex information-proc- 
essing tasks. 
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Gestalt Theories 


The theory we have presented resem- 
bles the associationist theories largely in 
its acceptance of the premise of mecha- 
nism, and in few other respects. It re- 
sembles much more closely some of the 
Gestalt theories of problem solving, and 
perhaps most closely the theories of “di- 
rected thinking” of Selz and de Groot. 
A brief overview of Selz’s conceptions 
of problem solving, as expounded by 
de Groot, will make its relation to our 
theory clear. 

1. Selz and his followers describe 
problem solving in terms of processes 
or “operations” (2, p. 42). These are 
clearly the counterparts of the basic 
processes in terms of which LT is speci- 
fied. 

2. These operations are organized in 
a strategy, in which the outcome of each 
step determines the next (2, p. 44). 
The strategy is the counterpart of the 
program of LT. 

3. A problem takes the form of a 
“schematic anticipation.” That is, it is 
posed in some such form as: Find an X 
that stands in the specified relation R 
to the given element E (2, pp. 44-46). 
The counterpart of this in LT is the 
problem: Find a sequence of sentences 
(X) that stands in the relation of proof 
(R) to the given problem expression 
(E). Similarly, the subproblems posed 
by LT can be described in terms of 
schematic anticipations: for example, 
“Find an expression that is ‘similar’ to 
the expression to be proved.” Many 
other examples can be supplied of 
“schematic anticipations” in LT. 

4. The method that is applied to- 
ward solving the problem is fully speci- 
fied by the schematic anticipation. The 
counterpart in LT is that, upon receipt 
of the problem, the executive program 
for solving logic problems specifies the 
next processing step. Similarly, when 
a subproblem is posed—like “prove the 
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theorem by substitution”—the response 
to this subproblem is the initiation of 
a corresponding program (here, the 
method of substitution). 

5. Problém solving is said to involve 
(a) finding means of solution, and (5) 
applying them (2, pp. 47-53). A coun- 
terpart in LT is the division between the 
similarity routines, which find “likely” 
materials for a proof, and the matching 
routines, which try to use these mate- 
rials. In applying means, there are 
needed both ordering processes (to as- 
sign priorities when more than one 
method is available) and control proc- 
esses (to evaluate the application) (2, 
p. 50). 

6. Long sequences of solution meth- 
ods are coupled together. This coupling 
may be cumulative (the following step 
builds on the result of the preceding) 
or subsidiary (the previous step was 
unsuccessful, and a new attempt is now 
made) (2, p. 51). In LT the former is 
illustrated by a successful similarity 
comparison followed by an attempt at 
matching; the latter by the failure of 
the method of substitution, which is 
then followed by an attempt at detach- 
ment. ; 

7. In cumulative coupling, we can dis- 
tinguish complementary methods from 
subordinated methods (2, p. 52). The 
former are illustrated by successive sub- 
stitutions and replacements in succes- 
sive elements of a pair of logic expres- 
sions. The latter are illustrated by the 
role of. matching as a subordinate proc- 
ess in the detachment method. 

We could continue this list a good 
deal further. Our purpose is not to 
suggest that the theory of LT can or 
should be translated into the language 
of “directed thinking.” On the con- 
trary, the specification of the program 
for LT clarifies to a considerable ex- 
tent notions whose meanings are only 
vague in the earlier literature. What 
the list illustrates is that the processes 
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that we observe in LT are basically the 
same as the processes that have been 
observed in human problem solving in 
other contexts. 


PERFORMANCE AND LEARNING 


LT is primarily a performance ma- 
chine. That is to say, it solves prob- 
lems rather than learning how to solve 
problems. However, although LT does 
not learn in all the ways that a human 
problem solver learns, there are a num- 
ber of important learning processes in 
the program of LT. These serve to 
illustrate some, but not all, of the forms 
of human learning. 


Learning in LT 


By learning, we mean any more or 
less lasting change in the response of 
the system to successive presentations 
of the same stimulus. By this defini- 
tion—which is the customary one—LT 
does learn. 

1. When LT has proved a theorem, 
it stores this theorem in its memory. 
Henceforth, the theorem is available as 
material for the proof of subsequent 
theorems. Therefore, whether LT is 
able to prove a particular theorem de- 
pends, in general, on what theorems it 
has previously been asked to prove. 

2. LT remembers, during the course 
of its attempt to prove a theorem, what 
subproblems it has already tried to 
solve. If the same subproblem is ob- 
tained twice in the course of the at- 
tempt at a proof, LT will remember 
and will not try to solve it a second 
time if it has failed a first. 

3. In one variant, LT remembers 
what theorems have proved useful in 
the past in conjunction with particular 
methods and tries these theorems first 
when applying the method in question. 
Hence, although its total repertory of 
methods remains constant, it learns to 
apply particular methods in particular 
ways. 
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These are types of learning that 
would certainly be found also in human 
problem solvers. There are other kinds 
of human learning that are not yet rep- 
resented in LT. We have already men- 
tioned one—acquiring new methods for 
attacking problems. Another is modi- 
fying the descriptions used in searches 
for similar theorems, to increase the effi- 
ciency of those searches. The latter 


learning process may also be regarded 
as a process for concept formation. We 
have under way a number of activities 
directed toward incorporating new forms 
of learning into LT, but we will post- 
pone a more detailed discussion of these 
until we can report concrete results. 


What is Learned 


The several kinds of learning now 
found in LT begin to cast light on 
the pedagogical problems of “what is 
learned?” including the problems of 
transfer of training. For example, if 
LT simply stored proofs of theorems as 
it found these, it would be able to prove 
a theorem a second time very rapidly, 
but its learning would not transfer at 
all to new theorems. The storage of 
theorems has much broader transfer 
value than the storage of proofs, since, 
as already noted, the proved theorems 
may be used as stepping stones to the 
proofs of new theorems. There is no 
mystery here in the fact that the trans- 
ferability of what is learned is depend- 
ent in a very sensitive way upon the 
form in which it is learned and remem- 
bered. We hope to draw out the impli- 
cations, psychological and pedagogical, 
of this finding in our subsequent re- 
search on learning. 


CONCLUSION 


We should like, in conclusion, only to 
draw attention to the broader impli- 
cations of this approach to the study 
of information-processing systems. The 
heart of the approach is describing the 
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behavior of a system by a well speci- 
fied program, defined in terms of ele- 
mentary information processes. In this 
approach, a specific program plays the 
role that is played in classical systems 
of applied mathematics by a specific 
system of differential equations. 

Once the program has been specified, 
we proceed exactly as we do with tra- 
ditional mathematical systems. We at- 
tempt to deduce general properties of 
the system from the program (the equa- 
tions); we compare the behavior pre- 
dicted from the program (from the 
equations) with actual behavior ob- 
served in experimental or field settings; 
we modify the program (the equations) 
when modification is required to fit the 
facts. 

The promise of this approach is sev- 
eral-fold. First, the digital computer 
provides us with a device capable of 
realizing programs, and hence, of actu- 
ally determining what behavior is im- 
plied by a program under various en- 
vironmental conditions. Second, a pro- 
gram is a very concrete specification of 
the processes, and permits us to see 
whether the processes we postulate are 
realizable, and whether they are suffi- 
cient to produce the phenomena. The 
vaguenesses that have plagued the the- 
ory of higher mental processes and other 
parts of psychology disappear when the 
phenomena are described as programs. 

In the present paper we have illus- 
trated this approach by beginning the 
construction of a thoroughly operational 
theory of human problem solving. There 
is every reason to believe that it will 
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prove equally fruitful in application to 
the theories of learning, of perception, 
and of concept formation. 
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A NOTE ON PHYSIOLOGICAL MECHANISMS 
AND PSYCHOLOGICAL IMPLICATIONS 
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Recent experiments by Garcia et al. 
(11, 13, 14) appear to be of great in- 
terest to psychologists studying that as- 
pect of learning called avoidance be- 
havior. These studies have shown that 
exposure to Co® acts as an uncondi- 
tioned stimulus (US) to produce avoid- 
ance behavior to the cues associated 
with the presentation of the radiation. 
In a footnote to one of these reports it 
was noted that “the physiological mecha- 
nisms through which radiation is ca- 
pable of acting as an unconditioned 
stimulus are as yet unknown” (13, p. 
40). It is the purpose of this note to 
indicate possible physiological mecha- 
nisms through which this effect occurs 


and to comment upon the importance 

of this phenomenon for psychology. 
Wynne and Solomon (22) have shown 

that interfering with the normal func- 


tioning of the peripheral autonomic 
nervous system (ANS) by surgical and 
pharmacological techniques interferes 
with an animal’s ability to acquire an 
avoidance response which, when learned, 
in some cases undergoes spontaneous 
extinction. Auld (3) reports that tet- 
raethylammonium, a drug which blocks 
impulses through the autonomic gan- 
glia, has a depressive effect upon speed 
of response in an escape-avoidance situ- 


1The author would like to thank Ernest 
Furchtgott and John Garcia for their com- 
ments on an early draft of this note. 

2 This paper was written while the author 
was on active duty with the U.S. Army. The 
opinions and conclusions contained in this re- 
port are those of the author and should in no 
way be construed as reflecting the views or 
endorsement of the Department of the Army. 
Present address: V. A. Research Hospital, 
Chicago. 


ation, although the possibility of a con- 
founding effect due to a depressant ac- 
tion of the drug upon motor activity has 
been noted by Brady (4). By using 
a serial discrimination problem and uti- 
lizing such measures as errors, trials to 
a criterion, and trials to extinction, one 
may evaluate the effects of autonomic 
block that are independent of the effects 
of the drug upon activity or motor ca- 
pacity of the organism. Under these 
conditions it was found that tetraethyl- 
ammonium as well as hexamethonium, 
a second drug which has as one of its 
major effects the block of impulses 
through the autonomic ganglia, inter- 
feres not only with learning, utilizing 
escape from shock as motivation (2), 
but also interferes to some extent with 
learning in less stressful situations (1). 
From these studies one may conclude, 
although tentatively because of a short- 
age of confirmatory evidence, that the 
cues associated with the normal function- 
ing of the ANS are important in goal 
directed, integrated behavior. Whether 
this is true because of an increased drive 
state produced by ANS functioning (for 
a recent summary see 21) or because of 
the feedback to the cortex from the ANS 
(5) is of little import for the considera- 
tions presented in this paper. 

In a thorough review of the relation- 
ships between irradiation injury and 
host defense mechanisms, Donaldson and 
Marcus (7) have shown that irradia- 
tion-induced stress produces an increase 
in adrenal cortical function. This con- 
clusion is based upon the work of 
Dougherty and White (8), Patt et al. 
(20), North and Nims (19), and Hoch- 
man and Bloch-Frankenthal (15), who 
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found decreases in ascorbic acid after 
irradiation. Nims and Sutton (18) pre- 
sent data which indicate that the de- 
crease in adrenal cholesterol level as 
well as the polydipsia which accom- 
panies whole body radiation is the re- 
sult of increased activity of the pitui- 
tary-adrenal system. Lasser and Sten- 
strom (16), working with humans fol- 
lowing pelvic area irradiation, concluded 
that the adrenal cortex underwent defi- 
nite changes in the course of irradia- 
tion, although these changes did not 
appear to be correlated with clinical 
“radiation sickness.” * 

If, then, the feedback associated with 
ANS functioning induced by irradiation 
has the same properties as the autonomic 
feedback associated with electric shock, 
a sudden loud noise, or any number 
of other stimuli, we would hypothesize 
that, just as the pairing of environmen- 
tal cues with electric shock causes these 
cues to acquire fear-inducing properties, 
so the pairing of environmental cues 
with irradiation should have this effect. 
It is these cues, then, which, when later 
presented without electric shock or ir- 
radiation, produce avoidance behavior. 

Gastric changes, general malaise, and 
nausea are also known to accompany 
irradiation (Furchtgott; * Davis et al., 
6; Leary, 17) and may well cause ANS 
feedback as well as feedback through 
the proprioceptive fibers of the somatic 
nervous system. This feedback also 
may become associated with environ- 
mental cues in such a way that upon 
presentation of the environmental cues 
an avoidance response to these cues is 
manifest.® 


8 Due to differences in dosage and exposure 
time, these studies are not directly applicable 
to the work of Garcia et al. However, it will 
be assumed tentatively that the time-dose pa- 
rameter used by Garcia et al. results in ANS 
effects similar to those produced in those stud- 
ies concerned more explicitly with irradiation 
and ANS changes. 

* Personal communication from E. Furcht- 
gott, University of Tennessee, May, 1957. 


Jack ARBIT 


The impact, from the psychologist’s 
point of view, of the studies by Garcia 
et al. is twofold. First, it appears that 
a US may produce avoidance condi- 
tioning even when the subject is not 
aware directly of its action. Awareness 
in this sense refers to the functioning 
of particular peripheral somatic affer- 
ents. When using electric shock to the 
feet of a rat through a grid upon which 
it stands, pain receptors in the feet 
supply awareness of the location of the 
trauma. When the US is radiation, 
particularly at minimal dosages, the ani- 
mal has no awareness of the trauma 
through the somatic nervous system. 
Some knowledge, however, that it is 
undergoing a stress may be mediated 
through the action of the ANS, the 
changes in gastric functioning, and the 
general malaise and nausea produced by 
irradiation. 

Second, the use of radiation as a US 
provides a solution to the problem noted 
by Solomon and Brush (21) of the 
general lack in experimental psychology 
of aversive stimuli other than electric 
shock. In this area the implications of 
the studies by Garcia et al. for further 
research are vast indeed. In a T maze 
will rats learn to turn away from a goal 
box in which they have been irradiated? 
What is the function of the curve relat- 
ing drive strength and dosage level? 
What are the temporal parameters as- 
sociated with the use of radiation as a 
US? Will a rat learn an instrumental 
response, such as bar pressing, to turn 
off a radiation source?*® A review of 


5In a recent study, Garcia and Kimeldorf 
(10) also reach the conclusion that the physio- 
logical mechanism underlying avoidance condi- 
tioning through irradiation may be stimulation 
of the ANS, although their evidence is some- 
what different from that presented in this 
paper. 

6 Since writing this paper, it has come to 
the author’s attention that a program of re- 
search at the U. S. Naval Radiological De- 
fense Laboratory has been undertaken with 
just such questions in mind (10, 12). 
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the behavioral effects of ionizing radia- 
tion may be found in Furchtgott (9). 
The relative importance of radiation as 
an aversive stimulus as compared to, let 
us say, bright light or intense sound, 
appears to be in the greater poten- 
tialities it offers for elucidating the role 
of the underlying physiological mecha- 
nisms in learning and the problem of 
learning without “awareness.” 
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The recent upsurge of interest in 
physiological determinants and physical 
models of behavior has raised or re- 
opened certain fundamental questions 
about the logical status of psychology as 
an autonomous discipline among the sci- 
ences. Some of the discussions may 
fairly be summarized as implying that 
physiological or physical concepts are in 
some sense more basic than those of psy- 
chology and that, therefore, causal ex- 
planation of behavior will utimately be 
expressed in those terms. The contro- 
versy over the nature of the hypothetical 
construct (HC) in psychological ex- 
planation is a current example. Krech 
(16) has insisted that HCs must have 
neurophysiological reference or locus, 
and that psychologists should be content 
to define such things as needs, tensions, 
or cognitive structures as neural events. 
While this particular view has been criti- 
cized (2, 15), and there is much agree- 
ment that neurophysiological content is 
irrelevant in HCs (20), the more general 
orientation—that fundamental explana- 
tion will be reductive—continues to be 
influential. 

Psychologists are not alone in being 
concerned about this problem. Anthro- 
pologists such as Kroeber and White 
have felt called upon to defend the au- 
tonomy of their discipline against those 
who have tried to explain culture in 
terms of the concepts of psychology or 
even biology. (White caustically com- 
ments that some anthropologists “have 
sold their culturological birthright for 


1 The author was a Social Science Research 
Council postdoctoral fellow at the University 
of California during the time in which this 
paper was prepared. 


a mess of psychiatric pottage” [25, p. 
xix]). In turn, prominent biologists 
such as Needham, Haldane, Woodger, 
and Bertalanffy have argued that their 
own discipline cannot be considered sim- 
ply an application of chemistry and 
physics. 

Obviously, an inherent attraction of 
reductive explanation is its implications 
for possible ways of unifying the sepa- 
rate scientific disciplines. Since the 
unity of science is an ultimate aim of 
many scientific workers, the reductive 
point of view is not likely to be aban- 
doned in the absence of reasonable al- 
ternative approaches to that goal. A 
commitment to reductionism, either be- 
cause of its implications for the unity of 
science, or because of the belief that it 
represents more fundamental explana- 
tion, undoubtedly influences the strategy 
of work of many scientists.? For this 
reason alone it would seem worth while 
to assess the doctrine in some detail. 

Some considerations of the reduction- 
ism problem have tended to dismiss it. 
One basis for dismissal is the assertion 
that the answer to the problem is en- 
tirely empirical in nature, depending on 
the course of future developments of 
science about which speculation is ad- 
mittedly dangerous. This view seems 
unwarranted; while the ultimate rela- 
tions among the sciences will be an em- 
pirical outcome, at any given point in 
time, the relations among the sciences 


2Sound empirical work, of course, requires 
no defense, whether motivated by reductionis- 
tic aims or not. Nothing said in this paper 
should be interpreted as depreciating the value 
of empirical or theoretical efforts to bridge the 
gap between disciplines. 
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are legitimate and important questions 
for logical analysis. Another basis for 
dismissal, especially where the disci- 
plines involved are psychology and 
physiology, is the adoption of the reduc- 
tionistic view as a logical or an in-prin- 
ciple certainty. The soundness of this 
view, also, is open to question, as will be 
shown. The purpose of this paper, then, 
is to examine the problem of reduction- 
ism and to try to make a small begin- 
ning in separating issues which are logi- 
cal in character from those which are 
empirical. In the course of our analy- 
sis, it will be contended that there are 
certain /ogical barriers to any present- 
day physiological reductionism. 


THE DocTRINE OF REDUCTIONISM 


The essence of reductionism would 
seem to include four related general 
propositions. (a) The several disciplines 
or sciences may be considered as hier- 
archically ordered from, e.g., physics at 


the base through chemistry, biology, and 
psychology, to the social and historical 
disciplines at the top.* (6) The second 
essential aspect of reductionism is the 
proposition that the terms or concepts 
and the relations or laws of one dis- 
cipline may fully and without loss of 
meaning be translated into or deduced 
from those of another discipline. (c) 
Such deduction or derivability proceeds 
only in one direction, from lower to 


3 Finer discriminations can, of course, easily 
be made by including the well-known “border” 
disciplines such as biochemistry or social psy- 
chology. But the fact that there is no sharp 
break between the sciences, and that it is fre- 
quently difficult to tell where one leaves off 
and the other begins, need not, in itself, chal- 
lenge the autonomous existence of the several 
disciplines. What may be implied by ordering 
them in a hierarchy from lower to higher will 
be discussed shortly; for the moment it is only 
important to ¢onsider that this is one of the 
notions essential to the doctrine of reduc- 
tionism. 
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higher * levels in the hierarchical order- 
ing, and hence the term “reductionism”; 
terms and laws of the higher discipline 
are “reduced” to those of a lower one. 
Thus, in our earlier example, the psy- 
chological term “cognitive structure” is 
considered translatable into—deducible 
from—terms belonging to neurophysi- 
ology: (d) The final aspect is the im- 
plicit or explicit proposition that the 
lower the level of terms employed to 
explain a given phenomenon, the more 
causal or fundamental or basic the ex- 
planation. This is really only a corol- 
lary of the first point if certain assump- 
tions about the nature of the hierarchical 
ordering are made. These four proposi- 
tions together would seem to constitute 
the essential meaning of reductionism as 
a general doctrine. An adherent of that 
point of view may not, of course, sub- 
scribe to all of its aspects. 

The primary focus of this paper is 
upon the issues attending the reduction 
of psychology to physiology, and our 
evaluation of the doctrine will for the 
most part be oriented toward that spe- 
cific context. Within that context, the 
following comments are illustrative of 
the position which supports the doc- 
trine. “Logically and in principle, 
physiological reduction is a certainty. 

4 Terms in this paper referring to “position” 
in the hierarchy of the sciences, e.g., higher- 
lower, upward-downward, top-bottom, are by 
no means to imply any valuative judgment. 
The meaning of position in the hierarchy has 
been variously specified, for example, as re- 
ferring to levels of abstraction or levels of 
integration, or as referring to the order of his- 
torical evolution within the universe of the sub- 
ject matter of the sciences, or even to the order 
of historical emergence of the sciences them- 
selves (25). As pointed out later, the concept 
of levels of science is not an analytically clear 
one (cf. 17). For present purposes it is suf- 
ficient to take note of the existence in scientific 
discourse of such a hierarchical concept, and to 
recognize the traditional general ordering which 
places the physical sciences at the base, the 
biological sciences in the middle, and the social 
sciences at the top of the hierarchy. 
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Every bit of behavior and everything 
that can, like conscious contents, be 
defined in terms of behavior has its 
physiological correlate” (2, p. 442); 
“Relative to the ‘molar’ (or macro-) 
account given by behavioristic psychol- 
ogy, the neurophysiological account is 
a micro-description of the very same 
events and processes” (10, p. 623); and 
finally, “. . . molar behavioristics is in 
theory completely reducible to under- 
lying neurophysiological principles. . . . 
A completely deterministic neurophysi- 
ology must of necessity permit deriva- 
tion of all molar behavioral laws” (20, 
pp. 261-262). An obvious corollary of 
these statements is the logical reduci- 
bility of physiological principles in turn 
to those of chemistry and ultimately of 
physics. 

Any challenge to these kinds of state- 
ments and their implications can be seen 
to require both logical and empirical 
arguments. We shall try to show where 
each kind is appropriate. 

To begin with, to speak of reducing 
one discipline to another requires that 
the terms or concepts of the one be dis- 
tinguishable from those of the other. 
This is not an easy requirement. Wood- 
ger (26) calls it an interesting method- 
ological question to inquire how one 
knows what belongs to the language of 
neurology and what belongs to that of 
psychology. Similarly, in commenting 
on the new terms which will accrue as 
science develops, Hempel (12) notes 
that it is by no means certain that each 
of these terms will be readily classifiable 
as physical or nonphysical. What seems 
to be a necessary preliminary for our 
examination of physiological reduction- 
ism is some general criterion for separat- 
ing or identifying the terms of psychol- 
ogy and physiology. If this is accom- 
plished by defining psychology in a cer- 
tain way, it should make apparent some 
logical barriers to the possibility of a 
physiological reduction. 
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A FUNCTIONAL DEFINITION OF 
PsYCHOLOGY 


Admittedly, the definition of any sci- 
entific discipline is somewhat arbitrary; 
despite this, it is certainly possible to 
obtain adequate agreement on criteria 
for segregating one discipline from an- 
other or for grossly circumscribing the 
domain of a particular science. Among 
psychologists there is considerable agree- 
ment that the scope and subject matter 
of concern is the behavior of whole, hu- 
man*® organisms. The difficulty with 
such a general statement is that the 
term “behavior” is not without am- 
biguity; psychologists have been no- 
toriously neglectful in providing a sys- 
tematic definition of a response. This 
laxness has, it is felt, obscured the con- 
ceptual boundary between psychology 
and physiology. The present discussion 
of behavior as a psychological concept 
follows the implicit orientation of all 
functional behavior theories, and more 
specifically, the approaches of Kantor 
(14), Brunswik (5, 6, 7), and Tolman 
(24). 

The central point of these approaches 
is that behavior, gua psychological, re- 
fers to an organism-environment inter- 
action or relationship. Tolman (24) 
specifically states that the complete 
identification of any behavior-act re- 
quires reference to its relation to par- 
ticular goal-objects and the intervening 
means-objects with which it has com- 
merce. Kantor’s interbehaviorism makes 
essentially the same point. In consid- 
ering the question of where to establish 
the boundaries of a behavior, Bentley 
(1) similarly concludes that behavior 
must be recognized as a transdermal 
process or event whose description must 
immediately and functionally include the 
environmental and situational settings. 


5 The writer assumes that the study of ani- 
mal behavior by psychologists is merely pro- 
paedeutic to a science of human behavior. 
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Within this framework, then, behavior 
viewed psychologically is interactional 
or relational in nature; its specification 
or identification at the referential level 
requires the specification of a particular 
context and a set of relationships thereto. 
Our definition of psychology, therefore, 
excludes the study of organisms or physi- 
cal environments per se, and behavior 
may not be referred to either alone. 
The laws of behavior of a discipline so 
defined refer to the dynamics of organ- 
ism-environment functional interaction. 
The terms or concepts of those laws de- 
scribe what may be called an interaction 
or behavior space. 

This definition of psychology was un- 
dertaken as a means of providing a 
criterion for deciding whether a behavior 
term, or a law involving such a term, 
properly belongs to psychology or physi- 
ology. Our criterion requires of psy- 
chological terms that they have immedi- 
ate reference to a functionally defined 
environment or context. Before draw- 
ing the implications of these considera- 
tions for reductionism, a further com- 
ment on this kind of definition may be 
in order. Some objection may be raised 
to the relational or transdermal char- 
acter of the definition in that there is 
provided no palpable locus for a psy- 
chologically defined behavior. Those 
who raise such a query seem to be oper- 
ating within what Woodger (27) pic- 
turesquely describes as a “finger and 
thumb” philosophy of metaphysics, i.e., 
the notion that a thing is real or exists 
only if it can in principle be picked up 
between the finger and thumb. Inter- 
actions or relations, though not simple 
physical objects, are nevertheless real 
and concrete and can be precisely speci- 
fied by the conditions and course of their 
occurrence. 


INCOMPLETE DERIVABILITY OF TERMS 


It may now be asserted that the refer- 
ence of psychology, as defined, is pro- 
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foundly different from that of physiol- 
ogy. The terms and laws of the latter 
refer to intraorganismic or intradermal 
processes, or, at most, relations between 
an organism or its parts and the space 
defined by physics. They refer, in short, 
to the functioning of anatomical struc- 
tures or processes described by body 
parameters. To state one of the major 
contentions of this paper, the absence in 
contemporary physiology of any sys- 
tematic terms for describing the func- 
tional environment or context of be- 
havior would seem to preclude, on logi- 
cal grounds alone, any complete reduc- 
tion of psychology to physiology. These 
necessary and sufficient conditions for 
the terms of psychology cannot be de- 
scribed in physiological (or physical) 
terms alone. This “incompleteness” of 
the lower discipline’s language, in being 
able to specify only the physiological 
correlates but not the environmental cor- 
relates of a behavior or response, con- 
stitutes the logical impediment. This 
point obviously requires elaboration and 
further support. 

Let us take as an example an occur- 
rence described in common-sense, non- 
systematic language—the wave of an 
arm as two persons pass each other 
and compare the systematic descriptions 
of it by the two disciplines being dis- 
cussed. The systematic language of the 
physiologist enables him to rely on only 
body parameters or physical terms. He 
may thus speak of arm-displacement, 
changes in muscle-tension, metabolic 
rate, blood-volume distribution, and 
neural reactivity. In none of these 
terms is it systematically possible to 
take cognizance of the social context. 
On the other hand, the psychologist 
may describe the event as waving a 
greeting to a friend, or even, since 
micromediation is generally of little in- 
terest to him, and equifinality generally 
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taken for granted,* simply as greeting 
a friend. If psychological laws refer to 
interactions between organisms and func- 
tionally defined environments, only these 
latter descriptions of events can logically 
lead to the achievement of such laws. 
A discipline such as physiology, lacking 
such contextual terms, cannot therefore 
be considered logically equivalent; hence 
its adequacy cannot be guaranteed, even 
in principle, as a complete reduction 
base for psychology. 

One of the strongest empirical sources 
of support for some of these considera- 
tions may be found in the research 
analyses of Campbell (8, 9) and Smeds- 
lund (22, 23) evoked by the recent con- 
troversy over “what is learned.” As 
mentioned earlier, the term “response” 
has been conceptually neglected; this 
neglect seems, in turn, to be related to 
the inadequate attention given to the 
environment or context of behavior by 
many psychological theorists (cf. 13 in 
this connection). Brunswik (5, 6, 7), 
however, is one of those who has called 
attention to the problem in his emphasis 
upon distal achievement in the adjust- 
ment of an organism to its ecology. 
Beginning with this orientation, and ap- 
praising a variety of learning experi- 
ments, especially those dealing with 
transposition, both Campbell and Smeds- 
lund conclude that the learned response 
must be defined in environmental terms 
in order successfully to accommodate— 
predict—the actual research findings. 
Campbell states that “. . . the learned 
response is to be essentially defined in 
terms of a shift in the organism-environ- 
ment relationship rather than a motor 
response defined in terms of organism 
or body parameters alone” (9, p. 105). 

Scrutiny of the literature on reduc- 
tionism has showed only meager if any 
attention to the specific issue raised in 

® That is, the same psychological event may 


be served by (partly constituted of) an almost 
infinite variety of different physiological events. 
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this paper. Two writers may be cited 
whose remarks, made in other contexts, 
are pertinent to the logical soundness 
of our contention. In his Tarner lec- 
tures (26), Woodger stresses the role of 
environment as a determinant at vari- 
ous biological levels from zygote to 
whole human organism. He rejects the 
body-mind dualism in favor of speaking 
about persons and developing a person- 
language. The notion of person re- 
quires, for its very definition, environ- 
mental specification, and the latter, he 
observes, requires words belonging to 
sociology. To treat persons otherwise, 
ie., in terms of body parameters, loses 
sight of this fact: “But this is the only 
way in which we can treat them so long 
as we confine ourselves to the physical 
sciences, since these sciences do not pro- 
vide a vocabulary for speaking about 
them in any other way” (26, p. 261). 
Hempel has discussed the problem in 
relation to the possible derivability of 
all the laws of empirical science from 
those of physics (a logical corollary of 
physiological reductionism). Affirming 
that not all the terms of empirical sci- 
ence are definable by means of the vo- 
cabulary of physics, he asserts that 
“. . . a law containing, say, certain bio- 
logical terms cannot, in general, be logi- 
cally derived from a set of physical 
laws, which contain no biological terms 
at all...” (12, pp. 320-321).* Both of 
these writers seem in support of our 
point of view that there are logical bar- 
riers to any thorough-going physiologi- 
cal reductionism. The barriers reside 
in the absence of terms in the “lower” 
discipline which would enable the logical 
derivability of descriptions of the func- 
tional context of behavior and, thereby, 
the derivation of the laws of psychology. 


7 To achieve such a derivation requires some 
law connecting the biological concepts with 
the physical concepts. “But those connecting 
laws are not purely physical in character” (12, 
p. 321). And they have the character of 
empirical laws. 
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At least two kinds of questions can be 
raised about our analysis and are worth 
consideration at this point. The first 
of these is the possibility of overcoming 
the logical problem we have raised sim- 
ply by incorporating into physiology the 
category of terms we have suggested 
that it lacks. This is frequently what is 
implied by the phrase “in principle” in 
assertions about the possibility of re- 
ductionism. But as Sellars (21) has 
pointed out in another connection, this 
makes the entire problem an empty 
truism in that it involves a “tacit re- 
definition” of physiological theory to en- 
compass psychology. Such a redefini- 
tion is a statement about the future state 
of the sciences involved, and it there- 
fore transfers the discussion from logical 
to empirical grounds. That is, the ques- 
tion of whether a future physiology will 
be able to encompass psychology de- 
pends entirely upon the nature and di- 
rection of ongoing empirical development 
of both disciplines. It is to be noted 
here, too, that the meaning of reduction 
is always and only relative to a given 
state of the disciplines concerned. To 
suggest adding terms to physiology in 
order to make psychology deducible 
from it implies the “elevation” or “ex- 
pansion” of physiology just as much as 
it implies reduction of psychology. (In 
connection with these issues, see the 
Meehl-Sellars discussion of the logic 
of emergentism, 19.) Finally, it seems 
unlikely that scientific theory develops 
or advances by simple accretion of the 
terms of other theories. We will return 
to this point shortly, in considering re- 
ductionism and the unity of science. 

The second kind of question which 
may be raised is implicit in the earlier 
quote from Bergmann. He bases his af- 
firmation of the logical certainty of 
physiological reductionism on the propo- 
sition that “. . . everything that can be 
defined in terms of behavior has its 
physiological correlate” (2, p. 442). 
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The essential point of this position would 
be that the environmental reference of 
behavior upon which we based our defi- 
nition must, if effective, be represented 
within the organism in its physiology or, 
especially, neurophysiology. This is, 
in a sense, a proximal approach to be- 
havior rather than a distal one. Certain 
arguments may be brought to bear 
against this position, such as the ab- 
scence of strict one-to-one proximal- 
distal correlation—e.g., in perception— 
and the theoretical significance of vicari- 
ous functioning or equifinality. The 
major reply which may be made, how- 
ever, is that the “recovery” of actual 
behavioral phenomena from physiologi- 
cal correlates requires the conceptual 
coordination of these correlates to en- 
vironmental contexts. Thus the issue 
raised originally reappears, the neces- 
sity for terms to represent or describe 
the context of behavior. That such co- 
ordination can or will be accomplished 
in the future is an empirical rather than 
a logical problem, and therefore not a 
logical certainty. 

Our discussion of reductionism up to 
this point has concerned itself largely 
with the logical problems inherent in the 
second and third essential aspects of 
the doctrine as outlined at the start of 
this paper. Proper attention to the first 
and fourth aspects would extend the 
paper beyond practical space _limita- 
tions. Instead, we shall simply sketch 
some of the issue requiring attention. 

The first aspect has to do with the 
hierarchical ordering of the several sci- 
entific disciplines. Despite the wide- 
spread acceptance of the hierarchy no- 
tion—witness the frequent reference to 
“levels” of science, the employment of 
terms like “basic” to contrast disci- 
plines, and the characterization of cer- 
tain disciplines as “emergent” from 
others—it is not an analytically clear 
concept. Kroeber (17) remarks on the 
absence of any adequate attempt to ex- 
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amine systematically what the levels 
constitute or mean in terms of a theory 
of knowledge. Most of the discussions 
of what is meant by levels resolve into 
two positions which are generally con- 
sidered to exclude one another. One 
point of view conceives the levels of 
science to be a matter of methodology 
only, i.e., to refer to the kinds of pro- 
cedures employed by the various sci- 
ences, the size of their units of analysis, 
etc. The other point of view considers 
the levels to refer to substantive differ- 
ences in the events or phenomena dealt 
with by the various disciplines. Psy- 
chologists will be familiar with this con- 
trast from the Littman-Rosen (18) 
analysis of the molar-molecular prob- 
lem. A third possibility is that these 
two positions are correlated rather than 
mutually exclusive, namely, that sub- 
stantively different events require par- 
ticularly appropriate methodological pro- 
cedures for useful analysis. 

Each of these three views has certain 
implications for the doctrine of reduc- 
tionism. For example, the methodo- 
logical position would seem to favor the 
doctrine, since it assumes the events or 
phenomena to be the same and only the 
descriptions of them to be different. If 
only the descriptions differ, e.g., in size 
of unit, it should be logically possible 
to reduce the larger units to their smaller 
constituents. On the other hand, to 
assert a substantive difference between 
levels would seem to be unfavorable to 
reductionism. The events or phenomena 
of higher levels are considered different 
from—not the same ones as—those of 
the lower levels, and therein lies the dif- 
ficulty in reducing descriptions of one 
kind of event to those of another kind. 
No vitalistic or dualistic considerations 
need be involved in speaking of events 
as different; certainly organic events 
may in general be separated from in- 
organic ones, for example. Feigl’s dou- 
ble-language theory (10) of the mind- 
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body problem espouses the methodo- 
logical position in insisting that the fac- 
tual reference of the mentalistic, be- 
havioristic and neurophysiological lan- 
guages or levels of description is iden- 
tical, ie., involves the very same events 
and processes. Others concerned with 
the problem seem to adopt the substan- 
tive position; thus White (25) speaks 
of culture as a distinct class of events, 
a distinct order of phenomena. Woodger 
tentatively concludes that “. . . perhaps. 
in spite of superficial appearances, 
person-acts and behaviour [defined in 
physical or physiological terms] are not 
quite the same things .. .” (26, p. 284). 
The position taken by the present writer 
in differentiating psychological from 
physiological terms may be seen as com- 
patible with the substantive view. What 
may account for substantive differences, 
whether the substantive vs. methodologi- 
cal distinction itself is useful or defensi- 
ble, the issues involved in emergentism, 
and any fuller analysis of the implica- 
tions of the hierarchy of sciences for re- 
ductionism must be deferred for discus- 
sion elsewhere. 

The final aspec: of the reductionism 
doctrine has to do with the idea that 
causal explanation is advanced by the 
employment of terms of a lower-level 
discipline. In psychology, this notion 
identifies causal explanation with neuro- 
physiological reference. The key reason 
for this approach would seem to be the 
belief in the higher levels as simply de- 
rivable from, or applications of, terms 
and laws of lower disciplines. Once this 
idea is abandoned, causal explanation 
could just as logically proceed upward 
to sociological and anthropological con- 
cepts. Knowledge of causality is prob- 
ably best divorced from the hierarchy 
of sciences notion and considered in- 
stead to vary with the scope of the net- 
work in which any concept is embedded. 

We have tried to examine some of the 
logical and empirical problems related 
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‘to the doctrine of physiological reduc- 
tionism. Some of the considerations 
have led us to doubt that psychology 
can be reduced to physiology, though 
certainly many of the questions are of 
an empirical sort. Nothing thus far 
asserted in any way denies the possi- 
bility or the desirability of the unifica- 
tion of the sciences, the synthesis of psy- 
chology and physiology. What is ques- 
tioned is that such synthesis must pro- 
ceed by reduction, by one discipline de- 
vouring or incorporating the other. All 
of the sciences are developing, and their 
influence upon each other does not only 
proceed upward from physics. Berta- 
lanffy (3, 4), for example, sees certain 
biological developments, such as the 
notions of open systems, requiring ex- 
tensions of the conceptual system of 
physics. Unity of science for him refers 
only to the structural isomorphy of laws 
in the different fields of science, the ap- 
proach of General Systems Theory. 
Psychologists can also see the conceptual 
system of physiology as influenced by 
the data and concepts of psychology 
(11). Thus, unification of the sciences 
may proceed from above as well as from 
below. The continued autonomous de- 
velopment of each of the sciences will at 
least serve to specify the properties re- 
quired of any synthetic unifying scheme. 
This is probably part of what Brunswik 
had in mind when he wrote: “Insistence 
on reduction as a universal goal of sci- 
ence can only result in blighted spots on 
the landmap of scientific enterprise” (7, 
mi £57 J. 
SUMMARY 

This paper has had as its aim the in- 
stigation of renewed attention to the 
doctrine of reductionism, especially in 
terms of its implications for the rela- 
tionship of physiology and psychology. 
Despite the empirical character of the 
ultimate answer, it is asserted that the 
questions involved in the doctrine may 
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properly be the concern of a logical 
analysis. After briefly sketching four 
propositions which constitute the essen- 
tial notions of reductionism, the argu- 
ment focused upon the logical possi- 
bility of a complete translatability or 
derivability of the concepts and laws of 
psychology from those of physiology. 
The central contention was that the lat- 
ter, lacking terms to describe the be- 
havioral environment, was logically in- 
adequate as a base for a thoroughgoing 
reduction of the former. The remainder 
of the paper commented upon the rela- 
tionship of the doctrine to the idea of 
a hierarchical ordering of the sciences 
and to the possibility of achieving a uni- 
fication of science. 
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Hull (6, 7,8) clearly distinguishes 
between a habit (sHpr) and a drive 
state (D) and postulates that these 
interact in a multiplicative manner so 
as to generate a reaction potential 
(sEr). Thus: 


sER = f(D x sHr) 


In his discussion of factors affecting 
response decrement, Hull further pos- 
tulates the development of two forms 
of inhibition: an innate, fatigue-pro- 
duced reactive inhibition (Ip) and con- 
ditioned inhibition (sIp). 

The former is clearly conceived of 
and defined as a negative drive state, 
while the latter is considered a nega- 
tive habit phenomenon. Despite this 
distinction, and in conflict with his 
earlier insistence on a multiplicative 
relationship between habits and drives, 
Hull postulates that these two vari- 
ables interact in an additive fashion 
to produce inhibitory potential (Ip). 
When such an inhibitory potential is 
operative it is subtracted from reac- 
tion potential to give a resultant or 
net reaction potential (sEKz). Thus: 


sEr = f[(D X sHr) — (Ir + sIr)] 


There has been considerable criti- 
cism of this formulation by such 
writers as Gleitman et al. (5) and 
Koch (3). Osgood (10) and Zeaman 
(15) similarly recognize the inconsist- 
ency of the equation and propose that 


! This article is based upon a paper pre- 
sented to the XV International Congress of 
Psychology at Brussels in August 1957. The 
proposed equation was earlier made use of by 
Eysenck (4) in a theoretical analysis of 
“warm-up"’ phenomena. 


sIz, as a negativefhabit, be subtracted 
directly from sHpr, a positive habit, 
while continuing to allow Jp to be 
subtracted directly from sEr. Iwa- 
hara (9) recognizes that Jr, as a drive, 
must enter into some form of multi- 
plicative relationship, but, in order to 
avoid certain implications of his argu- 
ment, he then abandons s/z as a habit 
phenomenon and proposes to consider 
it only as a secondary drive. Such 
an abandonment of the concept of a 
negative habit would involve a radical 
revision of much existing theory, 
while its retention is not imcompati- 
ble with the achievement of internal 
consistency within the Hullian sys- 
tem. ‘ 

Iwahara bases his rejection upon 
only one possible modification of the 
basic equation, i.e., that inhibitory 
potential (fg) be considered as the 
product rather than the sum of re- 
active and conditioned inhibition. 
Symbolically : 


Ip = Ir x slr 


He points out that this implies that 
the inhibitory potential would be zero 
when either Jz or slp is zero, a conse- 
quence clearly inconsistent with the 
known facts of learning. Conditioned 
inhibition, however, may, as a habit, 
also be energized by positive drives, 
e.g., when response decrement persists 
after long rest subsequent to massed 
practice. Similarly, reactive inhibi- 
tion may interact with positive habits 
to lower reaction potential when no 
conditioned inhibition is present, as 
at the commencement of massed prac- 
tice or extinction. 
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Thus it is suggested that net re- 
action potential may well be deter- 
mined by the multiplicative interac- 
tion of a resultant drive state (D — 
Ir), and a_ resultant habit state 
(slTrp — sIpr), so that: 


sEx = f{(D — Ir) X (sHr — sIr)] 


The habit term in this equation is con- 
sistent with Osgood’s and Zeaman’s 
suggestion, while the drive term is 
consistent with Kimble’s (12) experi- 
mentally validated proposition that 
the amount of reactive inhibition a 
subject will tolerate is a function of 
his drivelevel. Thisequation is math- 
ematically equivalent to: 


» # = f{(D x slT x) _ (Ir > 4 sp) 
— (DX slr) + (Ir X sIr) ] 


the fourth term of which represents a 
paradoxical addition to positive re- 
action potential from the interaction 
of two inhibitory variables. Simi- 
larly, if both resultant drive and habit 
states are negative, the resultant re- 
action potential would be positive. 
Such a state of affairs would occur 
rarely in practice, but may furnish a 
theoretical explanation of such phe- 
nomena as the “ultraparadoxical” 
phase of inhibition observed by Pav- 
lov (11). The various inhibitory 
states of the organism induced by 
Pavlov in various wavs may be con- 
sidered as inhibitory drive states akin 
to reactive inhibition. In advanced 
stages of such inhibition, Pavlov noted 
that positive conditioned — stimuli 
tended to lose their effect, whereas 
“well developed negative stimuli’ 
(i.e., when sIg was predominant) 
“acquired definite excitatory proper- 
ties.” 

Any amendment of the Hullian 
equation must serve, not only to make 
Hullian theory internally consistent, 
but also to generate theorems con- 
sistent with empirical data. One such 
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theorem, derived from the present 


amendment, refers to stimulus dis- 
crimination learning, around which 
an apparently adequate theory in 
Hullian terms has been developed, 
particularly by Spence (8, 14). 

The solid lines in Fig. 1 convention- 
ally illustrate the algebraic summation 
theory of discrimination,” in which net 
reaction potential (sEp) is a result of 
the subtraction of generalized inhibi- 
tion (sJr) from generalized positive 
reaction potential (sEr). At the 
stage of learning illustrated, the net 
reaction potential attached to the 
nonreinforced or negative stimulus is 
well below the threshold for response, 
and the discrimination will be almost 
perfect. 


2? The positive and negative generalization 
gradients in the figure were not calculated by 
formula but merely estimated, by eye, from 
textbook examples. Errors in reproduction and 
resulting differences between the two gradi- 
ents will account for the unconventional hump 
in the curves of net reaction potentials. 
These are irrelevant to the argument in this 
paper. 

3 Hull claims that sg cannot fall below 
sLr, the reaction threshold, because, when 
sEr = sLpr, no further responses occur and so 
no further slr develops. This argument 
neglects the effect of oscillation potential. 
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Let us now consider the effect of 
increasing drive in this situation; and, 
for convenience, let us assume that 
drive is, in fact, doubled. According 
to orthodox Hullian theory, this 
would have the effect of doubling the 
positive reaction potential but the 
conditioned inhibition would remain 
unchanged. The generalized net re- 
action potential (sEz) would then be 
represented by the broken line in 
Fig. 1. The net potential attached to 
the nonreinforced stimulus is in fact 
higher than at the commencement of 
discrimination learning in the low 
drive situation: the discrimination 
would have broken down completely. 
Even with lesser increases of drive, 
its multiplicative relationship with 
habit strength would insure severe 
impairment of discrimination. 

If, however, the amended equation 
is employed, the doubled drive would 
have the effect of doubling both posi- 
tive and negative potentials. The 
generalized net potential would then 
be represented by the dotted line in 
Fig. 1 and, at any point along the 
stimulus dimension, would be double 
that in the low drive conditions. At 
the nonreinforced stimulus value this 
would involve only a slight increment 
in potential, as the initial value is al- 
ready subthreshold. Discrimination, 
while somewhat impaired, would not 
be expected to break down completely. 

Empirical evidence is clearly in 
favor of the prediction from the 
amended equation. Skinner (13), for 
example, reports that under low hun- 
ger drive rats achieve almost perfect 
discrimination, performing bar-press- 
ing responses when the box is dark 
and not pressing when the box is 
lighted. Under increased food de- 
When sEr = slr, owing to oscillation, the 
probability of response evocation will be 0.5. 
Only when sKp falls appreciably below sLr 
will this probability fall to a low level. 
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privation the discriminations do not 
break down, but become impaired in 
that there is some “‘leaking’’ of posi- 
tive responses to the negative stimu- 
lus. 

Another situation in which the 
alternative equations would yield 
different predictions as to the effects 
of changes in drive is that in which 
habit strength is equal to conditioned 
inhibition. Calvin et al. (1) carried 
out an experiment to show that, de- 
spite continued reinforcement and 
under conditions of repeated massed 
practice, rats will ultimately refuse 
to traverse a runway for food and that 
this inhibition is retained over lengthy 
periods of time without such practice. 
Calvin's original experiment has been 
severely criticized by Dinsmoor (2) 
but, in a recent unpublished study, 
D. C. Kendrick achieved essentially 
similar results, using thirst motivation 
and controlling the factors relevant to 
Dinsmoor’s criticisms. 

If animals, trained in this fashion, 
are retested under conditions of in- 
creased drive, Hull’s equation indi- 
cated that a reinstatement of the 
running performance should occur, 
whereas under decreased drive the in- 
hibition should be more effective than 
in the original condition. According 
to the amended equation, change of 
drive in either direction, in that it 
affects sHr and slr equally, should 
have no effect on the balance between 
these two variables. Any change of 
drive, in that it alters the stimulus 
situation, may affect performance, but 
running should be no more frequent 
with increased than with decreased 
drive. In a pilot study, employing 
ten animals and testing this predic- 
tion, Kendrick found that three ani- 
mals responded positively under in- 
creased drive. Two of these and 
one other responded under decreased 
drive. No responses occurred when 
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drive level was unchanged. A more 
rigorous follow-up of this finding is 
now in progress. 


SUMMARY 


An amendment of the Hullian 
equation is proposed which, for both 
excitatory and inhibitory potentials, 
is consistent with Hull’s distinction 
between habit and drive states and 
the postulated multiplicative inter- 
action between the two. Theorems 


derived from this equation are com- 
pared with the analagous consequences 
of Hull’s formulation in the light of 
available empirical data. 
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